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Abstract 



Traditionally, consistency is the only criterion for the quality of a theory in logic-based 
approaches to reasoning about actions. This work goes beyond that and contributes to 
the meta-theory of actions by investigating what other properties a good domain de- 
scription should satisfy. Having Propositional Dynamic Logic (PDL) as background, 
we state some meta-theoretical postulates concerning this sore spot. When all pos- 
tulates are satisfied, we call the action theory modular. We point out the problems 
that arise when the postulates about modularity are violated, and propose algorith- 
mic checks that can help the designer of an action theory to overcome them. Besides 
being easier to understand and more elaboration tolerant in McCarthy's sense, mod- 
ular theories have interesting computational properties. Moreover, we also propose 
a framework for updating domain descriptions and show the importance modularity 
has in action theory change. 



Keywords: Reasoning about actions, modularity, dependence, theory change. 
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Resume 



Traditionnellement, la consistance est le seul critere pour decider de la qualite d'une 
theorie dans les approches logiques pour le raisonnement sur les actions. Ce travail 
va au dela de cela et contribue a la meta-theorie de Taction en proposant d'autres pro- 
prietes qu'une bonne description de domaine doit satisfaire. En utilisant la logique 
dynamique propositionnelle (PDL) comme logique de base, nous enongons quelques 
postulats meta-theoriques. Lorsque ces postulats sont satisfaits, nous disons que la 
theorie d'action est modulaire. Nous presentons les problemes qui surviennent lorsque 
nos postulats de modularite sont violes, et proposons des algorithmes pour aider le 
concepteur de la theorie a les resoudre. En plus d'etre plus faciles a comprendre et 
plus tolerantes a I'elaboration au sens de McCarthy, les theories modulaires ont des 
proprietes interessantes d'un point de vue computationel. Dans ce travail, nous pro- 
posons egalement une methode de mise a jour de descriptions de domaine et mon- 
trons I'importance de la modularite pour le changement de theories. 



Mots-cles : Raisonnement sur les actions, modularite, dependance, mise a jour de 
theories. 
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Resumo 



Tradicionalmente, consistencia tern sido o unico criterio de qualidade de teorias em 
abordagens logicas para raciocinio sobre agoes. O presente trabalho tern por obje- 
tivo ir ainda mais longe e contribui com a meta-teoria de agoes investigando que out- 
ras propriedades uma boa descrigao de dominio deve satisfazer. Usando a logica 
dinamica proposicional (PDL) como formalismo de base, enunciamos alguns postu- 
lados meta-teoricos. Quando uma dada teoria de agoes satisfaz todos os nossos pos- 
tulados, chamamo-a modular. Aqui nos mostramos os problemas que podem surgir 
quando os postulados de modularidade sao violados e igualmente propomos algo- 
ritmos que auxiliam o projetista da teoria de agoes a soluciona-los. Alem de mais 
faceis de entender e mais tolerantes a elaboragao, no sentido de McCarthy, teorias 
de agoes modulares apresentam tambem propriedades interessantes do ponto de 
vista computacional. Alem disso, nos aqui tambem apresentamos operadores para 
atualizagao de descrigoes de dominio, e mostramos a importancia da modularidade 
na modificagao de teorias. 



Palavras-chave: Raciocinio sobre agoes, modularidade, dependencia, modificagao de 
teorias. 
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Chapter 1 

where we try to convince the reader this work is worth reading 



Introduction 



"Well," said Pooh, "what I like best..." and then he had to stop 

and think. Because although Eating Honey was a very good thing to do, 

there was a moment just before you began to eat it which was better 

than when you were, but he didn't know what it was called. 

— A.A. Milne, from The House at Pooh Corner 

In logic-based approaches to knowledge representation, knowledge concerning a 
given domain is usually described by logical formulas, also called axioms. A set T 
of such formulas is called a (non-logical) theory. Theories used in applications are 
abstractions modeling observed phenomena with the goal of explaining and making 
predictions about them. That is also the case for reasoning about actions, where we 
are interested in theories describing the behavior of particular actions on properties of 
the world, called fluents. We call such theories achon theories (alias domain descriptions). 

Following the tradition in the reasoning about actions community, action theories 
are collections of statements that have the particular form: "if context, then effect after 
every execution of action"; and "if precondition, then action executable" . The first type 
of statement is used to express effect laws, i.e., formulas that relates an action with 
its outcome, given a particular context. The second kind of statement denotes exe- 
cutability laws, those formulas establishing the sufficient conditions under which an 
action is executable. Their dual gives us the necessary conditions for an action to be 
executable: "if precondition, then action impossible" . (Such statement can also be seen 
as a special case of effect laws whose effect is a contradiction.) 

Finally, in a representation of a dynamic domain, we also single out statements 
mentioning no action at all. These can represent laws about the static part of the 
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world, i.e., the constraints that determine which states are possible, or represent facts 
observed in a given state. We call the former static laws or domain constraints, while 
the later are referred to as simple observations. 

1.1 What Are Action Theories for? 

When describing action theories, the goal is to give a reasoning agent the ability to rea- 
son about a dynamic domain and perform rationally in the environment that its action 
theory models. Hence, action theories are made essentially to perform reasoning with. 
Among the different types of reasoning an agent can perform when interacting with 
its environment, we identify: 

• Checking consistency of its theory; 

• Predicting the effects of actions; 

• Explaining the observation of a given effect; 

• Establishing a plan to achieve a goal; 

• Check the executability or inexecutability of a given action; and 

• Revise and update its knowledge about the behavior of an action. 
We here briefly discuss about each of such tasks. 

Consistency Check 

Look at all the sentences which seem true and question them. 

— David Reisman 

Inconsistent theories are useless outside the realm of paraconsistent logics. Hence, 
given a theory, an important task is to check its consistency (Figure 1.1). 

? 



Knowledge 
base 




Figure 1.1: Checking consistency of a theory. 
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That is also the case for theories in reasoning about actions: an agent with incon- 
sistent behefs about the behavior of actions can perform unpredictably and be unsafe 
in real world applications. For instance, if the knowledge base of an agent conceived 
for an on-line flight reservation system becomes inconsistent, the agent may book a 
flight for a new passenger even if the flight is already full, producing an overbook for 
the company. 

Historically, logical consistency is the most used criterion for evaluating how good 
a given theory is. Consistency of theories in general has been extensively addressed in 
the literature on logic-based knowledge representation. In a more or less tacit way, it 
has also been studied for action theories [9, 99, 74, 96]. More recently, different notions 
of consistency specific to domain descriptions in reasoning about actions have been 
proposed [118, 72]. 

Our main claim in the present work, however, is that mere consistency is not 
enough to evaluate an action theory. We may have consistent domain descriptions 
that are not intuitive, and also intuitive theories that, although consistent, may be- 
have unpredictably and be difficult to manage and change. In order to capture these 
subtleties, something beyond consistency is required. We will come back to this point 
in the sequel. 

Progression, Regression and Plan Generation 

When performing reasoning with an action theory, one is naturally interested in doing 
progression, i.e., the prediction of action effects; regression, i.e., explaining the state of 
the world before a sequence of actions has taken place; and planning, which amounts 
to finding a sequence of actions whose outcome is the intended goal. 

Prediction is very difficult, especially about the future. 

— Niels Bohr 

Progression (Figure 1.2), also known as temporal projection, is the prototypical rea- 
soning problem for dynamic systems. Technically, it is the problem of determining 
whether a given set of fluents is true after the execution of a sequence of actions. For 
example, in an on-line booking system, querying the knowledge base whether the 
flight is booked after the customer has executed the action of paying is an instance of 
the progression problem. 
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Figure 1.2: Progression: reasoning about the future. 

The longer the explanation, the bigger the lie. 
— Chinese proverb 

Regression (Figure 1.3), also known as temporal explanation, consists in finding the 
set of fluents that hold at the initial situation before a sequence of actions were carried 
out. In the example above, given that the action of paying has been executed with the 
result that the flight is now booked, deducing that the client had a valid credit card 
number is an example of regression.^ 




Figure 1.3: Regression: reasoning about the past. 



Nothing happens unless first we dream. 
— Carl Sandburg 



Plan generation (Figure 1.4) is the task of knowing whether there exists a sequence 
of actions leading to an intended state of the world and, if that is the case, what that 
sequence is. In our running example, in order to get a flight booked, the agent must 



'This is an example of deductive regression [72]. 
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be able to find the actions necessary to achieve its goal. An associated task is plan vali- 
dation: given a sequence of actions and a goal, decide whether the actions constitute a 
plan for the goal. 



Current 
state 



actions 



Desired 
state 



Figure 1.4: Plan generation: what to do to achieve a goal. 



Tests for Executability and Inexecutability 



Try not. Do, or do not. There is no try. 

— Yoda 



All tasks of progression, regression and plan generation depend upon whether the 
involved actions are executable or not. Many approaches in the literature [83, 84, 72] 
assume that actions are always executable. They follow the so-called "tentativist" ap- 
proach, according to which one can always attempt to execute an action, whether its 
outcome is the expected one or not. We here prefer to adopt the "effectivist" approach, 
in which the execution of an action may fail. This allows us to differentiate action pre- 
conditions, i.e., the context in which the occurrence of the action is guaranteed, from 
the action's effect preconditions, i.e., the context in which the action, if executable, pro- 
duces the expected effect. For instance, having a gun is a precondition for shooting, 
while the gun being loaded is the precondition of the effect that the victim dies. 

Then, an important reasoning task in action theories is determining executabil- 
ity /inexecutability of an action in a given context. In our example, the agent must be 
able to detect that without a credit card number, the action pay is not executable (and 
consequently its effects do not apply). 

It turns out that such tasks can have a very high complexity when carried out in 
formalisms with a minimum of expressivity. One of our goals in this work is to show 
that we can simplify such a task if we have a theory satisfying some design principles. 



Introduction 



Revision and Update of Action Theories 

When we are no longer able to change a situation, 
we are challenged to change ourselves. 

— Viktor Frankl 

Just being consistent does not mean that the information coded in an action theory 
is intuitive. Nor does it mean that even being intuitive it will remain so along the 
evolution of the world. It is not difficult to conceive action theories describing laws 
about actions that are completely out of line with respect to the intuitive behavior of 
the world. In this sense, the agent must be able to revise its beliefs about the behavior 
of actions. In the same way, it can be the case that the world has just evolved, and 
then the action theory in the agent's knowledge base is out of date and need thus to 
be changed. Such situations are depicted in Figure 1.5. 

? 




Figure 1.5: Theory change: how to accommodate new information in a knowledge base. 

For instance, let the agent in the flight reservation system believe that always after 
booking a flight to a passenger, this one is confirmed to that flight. Now, if the agent 
learns that in the case where the flight is full, after booking it the passenger may go to a 
waiting list, it should be able to make this information fit together with its knowledge 
about the behavior of booking. 

Such cases of theory change are very important when one deals with logical de- 
scriptions of dynamic domains: it may always happen that one discovers that an ac- 
tion actually has a behavior that is different from that one has always believed it had. 
It is important to note, however, that independently of the method to carry out a 
change in the theory, deciding on its intuition remains a knowledge engineer's task. 

1.2 Modular Logic Project 

The design of theories in knowledge representation has much more in common with 
software engineering than one might think. In AI applications, a theory representing a 
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knowledge base is a piece of software. Hence in the same way as for software projects, 
one can talk about correctness and evolution of domain descriptions. 

Besides that, action theories play an important role when integrated into more 
complex knowledge representation systems. Those may involve representation and 
reasoning ability for e.g. knowledge, beliefs, desires and intentions. In order to the 
components of such an heterogeneous knowledge base fit together, some principles of 
good design should be considered prior to integrating all those components. Among 
the principles of the object-oriented paradigm in software development are the fol- 
lowing [108, 98]: 

1. Work with modules; 

2. Minimize interactions between modules; 

3. Organize the modules into well-defined layers to help minimize interactions. 
The goal is to have components of one layer using only components from im- 
mediate neighbors, wherever possible; and 

4. Anticipate what kind of extensions or modifications might be made in the future, 
and support this at design time so that one can extend the system with minimal 
disruption later. 

There seems to be an agreement that such principles for object-oriented program- 
ming or design are the same as for knowledge representation in general [38, 22, 110, 
59] as in reasoning about actions [2, 57, 64, 77]. All the principles above can be applied 
to the design of domain descriptions, too. We argue that a good domain description 
should be one whose consistency check and maintenance complexities are minimized, 
so that any further modification is localized, with a bounded scope. Moreover, we ex- 
pect that good design of a theory should improve its general performance. 

With this in mind, one can see the specification of domain descriptions as a task 
similar to project development in software engineering: Item 4 above is what has been 
called elaboration tolerance [88]. In this way, a representation is elaboration tolerant to 
the extent that the effort required to add new information (a new action or effect) to 
the representation is proportional to the complexity of that information [105]. Items 1, 
2 and 3 reflect the concept of modularity, which means that different modules should 
have as few elements as possible in common. 

A commonly used guideline in software development is to divide the software 
into modules, based on their functionality or on the similarity of the information they 
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handle. This means that instead of having a "jack of all trades" program, it is prefer- 
able to split it up into specialized subprograms. For instance, a program made of a 
module for querying a database and a module for checking its integrity is more mod- 
ular than a single module that does these two tasks at the same time. 

The major benefits of modular systems are reusability, scalability and better man- 
agement of complexity. Among the criteria commonly used for evaluating how mod- 
ular a piece of software is are the notions of cohesion and coupling [98, 108]. Roughly, 
cohesion is about how well defined a module is, while coupling is about how modules 
are interdependent. A common sense maxim in object-oriented design is maximize co- 
hesion of modules and diminish their coupling, and this paradigm can also be applied 
to reasoning about actions [3, 56, 57]. 

1.3 Objectives and thesis organization 

A priori consistency is the only criterion that formal logic provides to check the quality 
of action theories. Our objective in this work is to go beyond that, and argue that we 
should require more than the mere existence of a model for a given theory. 

Here we claim that all the approaches that are put forward in the literature are 
too liberal in the sense that we can have satisfiable action theories that are intuitively 
incorrect. We argue that something beyond the consistency notion is required in order 
to help us in evaluating a given theory. 

Our starting point is the fact that in reasoning about actions one usually distin- 
guishes several kinds of logical formulas. Among these are effect axioms, precondi- 
tion axioms, and domain constraints. In order to distinguish such non-logical axioms 
from logical axioms, we prefer to speak of effect laws, executability laws, and static 
laws, respectively. Moreover we single out those effect laws whose effect is _L (the 
contradiction), and call them inexecutability laws. 

Given these types of laws, suppose that the language is powerful enough to state 
conditional effects of actions. For example, suppose that some action a is inexecutable 
in contexts where cpi holds, and executable in contexts where (p2 holds. It follows 
that there can be no context where cpi A (p2 holds. Now ~'((pi A cpj) is a static law 
that does not mention a. It is natural to expect that ~'((pi /\ (pi) follows from the set 
of static laws alone. By means of examples we show that when this is not the case, 
then unexpected conclusions might follow from the theory T, even in the case that T 
is logically consistent. 
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This motivates postulates requiring that the different laws of an action theory 
should be arranged modularly, i.e., in separated components, and in such a way that 
interactions between them are limited and controlled. In essence, we argue that static 
laws may entail new effects of actions (that cannot be inferred from the effect laws 
alone), while effect laws and executability laws should never entail new static laws 
that do not follow from the set of static laws alone. We formulate postulates that 
make these requirements precise. It will turn out that in all existing accounts that al- 
low for these four kinds of laws [78, 83, 112, 23, 14, 119], consistent action theories can 
be written that violate these postulates. 

We here give algorithms that allow one to check whether an action theory satisfies 
the postulates we state. With such algorithms, the task of correcting flawed action 
theories can be made easier. 

The ideas we are going to develop in this thesis are not intended as the final word 
on how action theories should be formalized in reasoning about actions; indeed, they 
hardly constitute the initial word on how to do that! 

The present work is structured as follows: in Chapter 2, we establish the formal 
background needed to the core of the thesis. Chapter 3 makes a systematic analysis of 
some modularity approaches when applied to the case of reasoning about actions. In 
Chapter 4, we propose another view of decomposing a theory into modules, present- 
ing it in a simple framework that abstracts from the frame problem. We then present 
the solution to the frame problem we will rely on in the rest of this work and shows 
that it subsumes Reiter's regression technique (Chapter 5). After that, we investigate 
the behavior of existing solutions to the frame problem, including ours, in more com- 
plex scenarios (Chapter 6). In Chapter 7, we revisit our concept of modularity by 
giving a more fine grained account of it with the solution to the frame problem. We 
then generalize our modularity principle (Chapter 8) and present the main properties 
its satisfaction gives us. In Chapter 9, we make a step toward action theory update 
and present operators for contracting action laws. Before concluding, we make some 
discussion and address related work in the field (Chapter 10). 

Part of the material here presented have appeared earlier elsewhere: Chapter 4 is 
a joint work with Andreas Herzig that was published as [58]. Chapter 5 is the result 
of a joint collaboration with Robert Demolombe and Andreas Herzig that appeared 
in [25, 26]. A preliminary version of Chapter 6 appeared as [55]. Parts of Chapter 7 are 
an improvement of the preliminary works published in [56]. Chapter 9 is the result of 
a joint work with Andreas Herzig and Laurent Perrussel appeared in [52] and [51]. 
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where we get acquainted with the formal 
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Let these describe the indescribable. 
— Lord Byron 

In this chapter, we present the logical foundations which will serve as the basis 
for developing the central ideas of this work. As our base formalism, we have chosen 
modal logics [60, 16], and we describe action theories in *-free PDL, i.e., PDL without 
the iteration operator *. We here establish the ontology of dynamic domains and 
formally define what an action theory is. For more details on PDL, see [49, 50]; for the 
benefits of dynamic logic as a formalism for reasoning about actions, see [14, 43, 121]. 

2.1 Dynamic Logic 

LetSlct = {fli,fl2i • • .} be the set of all fltom/c flch'on consents of a given domain (2lct 7^ 0). 
Our main running example is in terms of the Walking Turkey Scenario [112], depicted 
in Figure 2.1. There, the atomic actions are load, shoot and tease. We use a as a variable 
for atomic actions. To each atomic action a there is an associated modal operator [a] . 
This gives us a multimodal logic [97]. Here we suppose that the underlying multi- 
modal logic is independently axiomatized (i.e., the logic is a fusion and there is no 
interaction between the modal operators [69, 70]). 

Let *prop = {pp P2, • • •} denote the set of all propositional constants, also called/Zuenfs 
or atoms. Examples of those are loaded, alive and walking. We use p as a variable for 
propositional constants. 

We suppose from now on that both sets 2lct and ^top are finite. 

11 
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Figure 2.1: The Walking Turkey Scenario. 

We use small Greek letters cp , ip , . . . to denote classical formulas, also called boolean 
formulas. They are recursively defiried m the following way: 

(p ::= p I T I _L I ^cp |(pA(p|(pV(p|cp— >cp|(pf->(p 

The set of all classical formulas will be denoted by g^mL 

Examples of classical formulas are walking — > alive and -^(bachelor A married). 

Given cp G ^vai, by valuations((p) we denote the set of all propositional valua- 
tions making cp true. We view a valuation as a maximally-consistent set of literals. 
For instance, if *prop = {alive, walking}, then there are four valuations: {alive, walking}, 
{alive , ^walking}, {-^alive , walking} and {-^alive, ^walking}. A classical formula cp is clas- 
sically consistent if and only if valuations[(p) ^ 0, i.e., there is at least one valuation in 
classical propositional logic that makes it true. We denote |= the standard logical 
consequence in classical propositional logic. 

The set of all literals is £it = *prop U {-^p : p £ ^prop}. Examples of literals are alive 
and -^walking. We will use £ as a variable for literals. If £ = -^p, then we identify -■£ 
with p. 

A clause x is a disjunction of literals. We say that a literal (. appears in a clause X/ 
written £ G X/ if ^ is a disjunct of x- 

We denote complex formulas (possibly with modal operators) by capital Greek 
letters O i , O2) • • • They are recursively defined in the following way: 

<D ::= (p 1 [fl]0 I (fl)(D |-(D|cDAcD|(DV(Dl<D^(D|(Df^(D 
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where O denotes a complex formula. The dual operator of [a] is {a) and it is defined by: 
(fl)0 =def ~'[fl]^0. Sequential composition of actions is defined by the abbreviation 
[fli;fl2]^ =def [«i][«2]^- Examples of complex formulas are loaded — > [shoot]^alive and 
hasGun — > {load; shoot) {^alive A ^loaded) . 

If T is a set of formulas (modal or classical), atm(T] returns the set of all atoms 
occurring in T. For instance, atm({-^^^p^, [a]p2}) = {p^>P2^■ 

For parsimony's sake, whenever there is no confusion we identify a set of formulas 
with the conjunction of its elements. The semantics is that for multimodal K [97, 10]. 

Definition 2.1 (PDL-model) 

A PDL-model is a tuple ./^ = {W,R) where W is a set of valuations (alias possible 
worlds), and R : 2lct — > 2^^^ a function mapping action constants a to accessibility 
relations K,, C W x W. 

As an example, for 2lci = {fli,fl2} and *prop = {Pi,P2J^' ^^ have the PDL-model 
^ = (W,K), where 



Kffll 



I ({^Pl,P2).{^Pl.P2}).K^Pl'P2}'{Pl.^P2}) 
Mai) ={({Pi,P2}'-tPl.^P2J')'KPl'^P2l'{Pl'^P2})l 

Figure 2.2 gives a graphical representation of ^ . 



fli 



fli 



fli 




^ (^VvV^ 



(Pi.^Pz) 




fl2 



Figure 2.2: Example of a PDL-model for 2lct = {fli ^ai], and ?ptop = {p^ ,P2}- 

Given .^^ = (W,_R), a € 2lct, and w,w' € W, we write i?,, instead of R[a), and 
wRflw' instead of w' E i?fl(w). 



14 Describing Action Theories 



Definition 2.2 (PDL truth conditions) 

Given a PDL-model J^ = {W,R), the satisfaction relation is defined as the smallest 
relation satisfying: 

• \= p (p is true at world w of model .M) ifp G w; 

• 1= [fl]0 if for every w' such thatwR^w' \^ O; and 

• the usual truth conditions for the other connectives. 

Definition 2.3 (Model of formulas) 

A PDL-model .^ is a model of <^ (noted |= O ) if and only if for all w G W, ^ ^.^ is 
a model of a set of formulas T (noted |= T) if and only if |= O for every O gT. 

In the model depicted in Figure 2.2, we have 1= Pi — > [ail^Pz ^^id |= p-^V pj- 

Definition 2.4 (Global consequence) 

A formula O is a consequence of the set of global axioms T in the class of all PDL- 
models (noted T ^ O ) if and only if for every PDL-model ^ , if ^ T,fhen\= O.^ 

We suppose that the logic under consideration is compact [33]. 

Having established the formal substratum our presentation will rely on, we 
present in the next section the different types of formulas we will henceforth use to 
describe dynamic domains. 

2.2 Describing the Behavior of Actions in PDL 

Before elaborating a theory, we need to specify what we are about to describe, i.e., 
what the formulas are supposed to interpret. Following the tradition in the literature, 
we identify a domain (alias scenario) with the actions we take into account and the 
fluents they can change. More formally, we have: 

Definition 2.5 (Domain signature) 

A domain signature is a tuple (2lct, ^rop). 

An example of a domain signature (domain, for short) is the well-known Yale 
Shooting Scenario [47], whose signature comprises the actions load, wait and shoot, 
and fluents loaded and alive. 



'instead of global consequence, in [14] local consequence is considered. For that reason, a further 
modal operator D had to be introduced, resulting in a logic which is multimodal K plus monomodal S4 
for □, and where axiom schema DCD — > [fl]0 holds. 
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The beginning of wisdom is to call things by their right names. 

— Chinese proverb 

Given a domain (2lct,!ptop), we are interested in theories whose statements de- 
scribe the behavior of actions of 2lct on the fluents of *Ptop. PDL allows for the rep- 
resentation of such statements, that we here call action laws. We distinguish several 
types of them. We call effect laws formulas relating an action to its effects. Statements 
of conditions under which an action cannot be executed are called inexecutability laws. 
Executability laws in turn stipulate the context where an action is guaranteed to be ex- 
ecutable. Finally, static laws are formulas that do not mention actions. They express 
constraints that must hold in every possible state. These four types of laws are our 
fundamental entities and we introduce them more formally in the sequel. 

Static Laws 

Frameworks which allow for indirect effects of actions make use of logical formulas 
that state invariant propositions about the world. Such formulas delimit the set of pos- 
sible states. They do not refer to actions, and we suppose here that they are expressed 
as formulas of classical propositional logic. 

Definition 2.6 (Static law) 

A static law^ is a formula cp G g^tnL 

In our running example, the static law walking — > alive says that if a turkey is 
walking, then it must be alive. Another one is saved <-> [mboxl V mhoxl), which states 
that an e-mail message is saved if and only if it is in mailbox 1 or in mailbox 2 or in 
both [15]. 

In some action languages, such as AR [65, 44] for example, we would write the 
statement a Iways alive — > walking, and in a Situation Calculus [90] variant, it would be 
the first-order formula 

ys.{Holds{walking,s) — > Holds{alive,s)]. 



^In the literature, static laws are often called domain constraints or integrity constraints. Because the 
different laws for actions that we shall introduce in the sequel could in principle also be called like that, 
we avoid these terms. 
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At first glance, no requirement concerning consistency of the static laws is made. 
Of course, we want them to be consistent, otherwise the whole theory is inconsistent. 
As we are going to see in the sequel, however, consistency of the static laws alone is 
not enough to guarantee the consistency and even the intuitiveness of an action theory 
as a whole. 

Effect Laws 

Logical frameworks for reasoning about actions contain expressions linking actions 
and their effects. We suppose that such effects might be conditional, and thus get a 
third component of such laws. 

In PDL, the formula [a] O states that formula d) is true after every possible execution 
of action a. 

Definition 2.7 (Effect law) 

An effect law^ for action a is of the form cp — > [a]^\>, where (p,ij> G 5^m[, with \\> classi- 
cally consistent. 

The consequent i|) is the effect which obtains when action a is executed in a state where 
the antecedent cp holds. An example of an effect law is loaded — > [shoot]^alwe , saying 
that whenever the gun is loaded, after shooting, the turkey is dead. Another one is 
T — > [tease]walking: in every circumstance, the result of teasing is that the turkey starts 
walking. For parsimony's sake, the latter effect law will be written [tease]walking. 

Note that the consistency requirement for i|) makes sense: if i|) is inconsistent, then 
we have an inexecutability law, that we consider as a separate entity and which we 
are about to introduce formally in the sequel. On the other hand, if cp is inconsistent, 
then the effect law is obviously superfluous. 

For the first example above, in action languages one would write the statement 

shoot causes -^alive if loaded ^ 
and in the Situation Calculus formalism one would write the first-order formula 

ys.[Holds{loaded, s) — > -^Holds{alive,do[shoot,s))). 



''Effect laws are often called action laws, but we prefer not to use that term here because it would also 
apply to executability laws that are to be introduced in the sequel. 
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Inexecutability Laws 

We consider effect laws with inconsistent consequents as a particular kind of law 
which we call inexecutability laws. (Such laws are sometimes called qualifica- 
tions [85].) This allows us to avoid mixing things that are conceptually different: for an 
action a, an effect law mainly associates it with a consequent iJj, while an inexecutabil- 
ity law only associates it with an antecedent cp, viz. the context which precludes the 
execution of fl. 

Definition 2.8 (Inexecutability law) 
An inexecutability law for action a is of the form cp — > [a] ±, where cp G 5^m[. 

For example, ^hasGun — > [shoot]!, expresses that action shoot cannot be executed 
if the agent has no gun. Another example is dead — > [tease] ±: a dead turkey cannot 
be teased. 

In AR we would write the statement 

impossible s/ioof \f^hasGun, 
and in the Situation Calculus, our example would be 

\/s.[^Holds{hasGun,s] — > -^Poss[shoot,s]]. 

Executability Laws 

With only static and effect laws one cannot guarantee that the action shoot can be 
executed whenever the agent has a gun. We need thus a way to state such conditions. 
In dynamic logic, the dual (fl)(p, defined as -'[fl]^(p, can be used to express exe- 
cutability. The formula (fl)T thus reads "execution of action a is possible". 

Definition 2.9 (Executability law) 

An executability law for action a is of the form (p — > {a)T, where cp G S'mL 

For instance, hasGun — > {shoot)T says that shooting can be executed whenever the 
agent has a gun, and T — > (tease) T, also written (feflse)T, establishes that the turkey 
can always be teased. 

Some approaches (most prominently Reiter's [99, 100]) use biconditionals of the 
form (p f-> (fl)T, called precondition axioms. This is equivalent to -■cp f-> [fl]-L, which 
highlights that they merge information about inexecutability with information about 
executability. Here we consider these entities to be different and keep them separate. 
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In action languages in general, such laws are not represented, they are rather im- 
plicitly inferred from inexecutability statements (cf. Section 8.2). In the Situation Cal- 
culus, our example would be stated as 

ys.{Holds[hasGun,s) — > Poss{shoot,s)). 

Whereas all the extant approaches in the literature that allow for indirect effects of 
actions contain static and effect laws, and provide a way for representing inexecutabil- 
ities (in the form of implicit qualifications [42, 78, 112]), the status of executability laws 
is less consensual. Some authors [102, 28, 83, 112] more or less tacitly consider that 
executability laws should not be made explicit but rather inferred by the reasoning 
mechanism. Others [78, 23, 14, 119] have executability laws as first class objects one 
can reason about. 

It seems a matter of debate whether one can always do without executabilities. In 
principle, it seems to be strange to just state information about necessary conditions 
for action execution (inexecutabilities) without saying anything about its sufficient 
conditions. This is the reason why we think that we need executability laws. Indeed, 
in several domains one wants to explicitly state under which conditions a given action 
is guaranteed to be executable, e.g. that a robot never gets stuck and is always able to 
execute a move action. And if we have a plan such as load; shoot {load followed by 
shoot) of which we know that it achieves the goal ^alive, then we would like to be sure 
that it is executable in the first place!^ In any case, allowing for executability laws 
gives us more flexibility and expressive power. 

2.3 Action Theories 

An ounce of action is worth a ton of theory. 
— Ralph Waldo Emerson 

Given a domain (2lct,*prop), let L denote the language of our formalism, i.e., all 
well formed sentences of the logic under consideration built upon the objects in the 
signature and the logical connectives. Let T be the theory (set of non-logical axioms) 
describing the behavior of the actions of the domain, i.e., T is a set of global axioms in 



''of course, this would require a solution to the qualification problem [85]. 
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Fitting's sense [33] of the types defined above. Let |=3 be a consequence relation (possibly 
nonmonotonic) defined on C . We thus define action theories: 

Definition 2.10 (Action theory) 

An action theory (alias domain description) is a tuple T> = {£, N,T), where £ is a 
language, T a set of formulas of C, and |=s a consequence relation defined on C. 

As an example of an action theory, consider Pjy,g = (£pdL) hpni > ■^)' where Cpoi is 
the set of all PDL-formulas, !=§„. is the consequence relation in PDL (cf. Definition 2.4), 
and the theory T is given by: 



r 



walking — > alive, ^loaded — > [load]loaded , 

loaded — > [shoot]^alive ,hasGun — > {shoot)T, 

-^hasGun — > [shoot]±, [tease]walking , 

{tease)T, {load)T 



Then V^f^ is an action theory in PDL formalizing the Walking Turkey Scenario [112]. 
Figure 2.3 below shows a PDL-model for the theory component of the domain de- 
scription above. 




Figure 2.3: A model for the Walking Turkey Scenario: /, iv, a, and h stand for, respectively, 
loaded, walking, alive and hasGun. Actions shoot, tease and load were abbreviated, respectively, 
to s, t and /. 
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Definition 2.11 (Action theory entailment) 

LetV = {£, N, T) be an action theory, and <D e C.V entails O (noted V ^ (D) if and 
only if T |=s O. 

(To avoid confusion, we remember that we denote entailment in classical proposi- 
tional logic by |=p|^.) 

In our action theory example, we have Djy,5 |= loaded — > [shoot]^walking and 'D^^,^g \= 
[tease]alive. 

Let Cn[V) = {O : P |= O} denote the set of all consequences of action theory V. 
We define when two action theories are equivalent: 

Definition 2.12 (Action theory equivalence) 

Action theories V^ and V2 are equivalent if and only ifCn[V^) = CniVj)- 

In the rest of this work, we analyze the design of action theories as defined here 
and see how difficult it can be to achieve the desired intuition. 
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Reasoning about Actions 



To know the road ahead, ask those coming hack. 

— Chinese proverb 

We here identify two main trends on modularity of descriptions: one pragmatic, 
programming language driven, and one logical theoretic driven. We point out that 
both proposals are inadequate as accounts of modularity when applied to theories in 
reasoning about actions. We show that they are either too weak or too strong and 
do not completely avoid unwanted interactions between modules. We also claim that 
modules designed following their directives may be as complex as whole theories. 

3.1 The Need for Modules 

Modularity has become one of the words of order in many areas of software devel- 
opment. That is also the case for knowledge representation and reasoning, where 
monolithic descriptions have shown to be of high complexity for dealing with. 

The last years have seen the flourish of plenties of papers [2, 46, 68, 57, 64] that 
in a more or less tacit way talk about concepts as modules, reusability, intelligibility, 
evaluation, maintainability, independence and self-content, elaboration tolerance and 
many others. Most of these terms are borrowed from software engineering, sometimes 
without a clear notion of the impacts that they can have when transplanted to domains 
where their use is not a matter of intuition, but rather they have to accommodate with 
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well established formal settings. Here we point out that this is not a simple task, 
especially when logic is the formal substratum in which knowledge is represented. 

Despite the apparent fragility of the well-known toy scenarios commonly used in 
this domain to illustrate typical problems in the area, things get more serious when we 
move to the "real" world. One can expect that action theories describing the behavior 
of actions for applications of real interest will be of very high complexity. By this we 
mean amount of information being represented, the internal relationship among data, 
the feasibility of inferences in a huge set of formulas, as well as the difficulty for future 
amendments. 

Thus, the question that naturally arises is "how can we ease the knowledge en- 
gineer's task in describing a domain"? One answer, of course, following the divide- 
and-conquer trend, is "modularizing the action theory". But what does it really mean 
to modularize an action theory? For that we give a (general) definition of a module 
prototype. 

Definition 3.1 (Module prototype) 

A module prototype of an action theory V = (£, |=3,T) is a description V' = 
(£', \=^',T') such that C CC, N' c ^andT' CT} 

A module prototype is just a syntactic-based fragment of a description V. Like in 
structural and object-oriented programming, to modularize an action theory is not just 
a matter of cutting the description in a whole bunch of slices. Such a decoupling must 
be done so that the resulting theory has interesting properties regarding the above 
requirements. We are going to see in the rest of this work that to be really considered 
as a module, pieces of descriptions are usually required to satisfy some desiderata. 

We can find in the literature several proposals on modularization of action the- 
ories that are quite close to software engineering and object-oriented programming. 
Some examples are the object-oriented first-order logic (OOFOL [1]) and its Situation 
Calculus variant [2], Gustafsson and Kvarnstrom's framework for elaboration toler- 
ance [46], and Lifschitz and Ren's modular action description language [77]. Despite 
the well developed formal background, such approaches are more focused on the 
implementation level (which is of course important) and either do not take into ac- 
count or make too restrictive assumptions about in order to get rid of an important 
issue when describing a domain: unforeseen interactions between modules, or even 
between components of a single module. 



' Module prototypes are thus seen as sub-descriptions, and action theories in our sense are themselves 
module prototypes. 
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In the same way, we see good work in the logician's community concerning modu- 
larity (or similar notions) of logical theories in general [38], and of theories in descrip- 
tion logics [22]. However, as we are going to see, when bringing such definitions to 
the case of reasoning about actions, we get a too restrictive notion of modularity with 
which either there is no way to modularize a description or the modules are difficult 
to understand. 

3.2 OO-driven Logical JModularity 

Regarding the titles of this and the next section, we do not want to say that the ap- 
proaches we analyze here are not logical. We just have put them apart because they 
are more engineering-oriented, in the sense that their respective formalisms have been 
mainly developed with the aim of serving as engineer tools. 

There are several proposals on modularization of action theories that are quite 
close to software engineering and object-oriented programming [2, 46, 77]. The main 
feature of these approaches is the decomposition of descriptions in a way similar to 
that programmers usually do in decomposing software applications. Given a domain, 
their parts are associated with sub-domains. Action theories are thus composed of 
sub-descriptions that interact in some way, e.g. by sharing common information, in- 
heriting properties [46, 77], or message passing [5, 6]. 

We here take the OOFOL formalism [1] and its Situation Calculus flavor [2] as 
our guiding paradigm in this section. The reason is that it is representative of this 
category, and the fact of being oriented to reasoning about actions will ease further 
comparisons. 

Amir [2, 4] focuses on design and maintainability of domain descriptions applying 
many of the concepts of the object-oriented paradigm in the Situation Calculus. In that 
work, guidelines for a partitioned representation of a given theory are presented, with 
which the inference task can also be optimized [5, 4, 6], as it is restricted to the part of 
the theory that is relevant to a given query. This is observed specially when different 
agents are involved: the design of an agent's theory can be done with no regard to 
others', and after the integration of multiple agents, queries about an agent's beliefs 
do not take into account the belief state of other agents. Such a feature of a description 
is called conditional independence [2]. 

The original approach is first-order, but we here present it using the syntax of PDL, 
which has no harm on its basic intuitions. 
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In the OOFOL approach, an action theory (£, \^,T) is decomposed in module 
prototypes (£i , \^,T^),..., {C^, \^, TJ such that 

• £i C £ is a PDL language ; 

• for every 1 < i < n, T^ = (A^, I^), where A^ is a set of formulas (axioms) such 
that £. (At) = £i (£i contains only the symbols appearing in formulas of At), and 
It C {£ : I £ d} is the module's interface, i.e., the literals it shares with other 
modules; and 

• ^ = Ui<i<.A,. 

Sub-descriptions are thus seen as objects in the object-oriented sense^, each one 
having its own data (the set of axioms A^) and a communication link with other ob- 
jects (its interface It). Two distinct objects do not necessarily need to have distinct 
languages, unless they are completely disconnected, i.e., atoms or actions in one of 
them are never taken into account in the others' inference. Given two distinct objects 
that are supposed to interact, their interface links establish (semantical) equality or 
equivalence between symbols in their respective languages and are restricted to only 
the symbols appearing in the interface (see below). 

For the case of reasoning about actions, each 7^ is designed so that the respective At 
component contains formulas of a specific type, i.e., descriptions are partitioned into 
a module for effect laws, a module for static laws, etc. As an example, the action the- 
ory Pjyfj, = (£pDL, l=pDL)^) formalizing the Walking Turkey Scenario (cf. Section 2.3) 
would be decomposed in 

'^wts} = {C^,^p^, {{walking^ ^ alive -i], {walking^, alive ^})) 

V^t,2={^2,y ,(| Tf^(teflse2)T, 1 ^^^ 
^^^ I hasGurij <-> {sliooti)^ J 

^loadeds — > [loadslloadedi, 
'^wtss = ('^s.hpDL, {i loaded^ — > [shootsl^alives, > ,{walking^,alive3})) 
[ [tease slwalking^ 

together with the equivalences |^p|_ walking^ <-> walking^^, and [^p\_ alive-\ <-> alive^, 
and the equalities teasej = tease^ and shootj = slioot^. These say, e.g. that walking^ 



^Do not confound with objects in the domain signature. In object-oriented programming, an object, 
roughly speaking, is an instance of a class that models an entity of the world [108, 98]. 
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in object T>^^^^ should be understood as having the same semantics as walking^ in 
object I'jyts3, and action shootz in object V^^^^^j should be interpreted as shoot^ in ob- 
ject T>^i^y This means, for example, that inferences regarding walking^ in V^^^^ also 
concern T)^^^^^. (For more details on how reasoning is carried out in descriptions that 
are decomposed that way, see [5, 6]. We here concentrate only in the modeling aspect 
and the impact it has on what we expect from modules.) 

Notice the modifications that we had to carry out with respect to the original 
formulas in P^^fg in order to decompose it with the method defined in [2]. Exe- 
cutability laws and inexecutability laws are mixed together: hasGun — > {shoot)T and 
-^hasGun — > [shoot]!, have been combined in the biconditional hasGun <-> {shoot)T. 
This is reminiscent of the principle of maximization of executabilities commonly used 
in the literature [78, 44]. We argue (cf. Section 8.2) that such assumption gives us less 
flexibility in the design of dynamical systems. 

If we want a better decomposed description, we should rather have defined 

'^luts^' = {'C^,[^p^, {{walking^ -^ alive ^}, {walking^, alive ^})) 

^°'" [ hasGuni^ {shootjjT J 

-^loadeds — > [load ^loaded ^^ 
Ayts3' = ('^3,l=pQ|_,('\ loaded^ — > [shoot^l^alives, > , {walking ^ alive 3})) 
I [tease slwalking^ 

T^wisA' = (/^4,hpD|_,({^^flsGMn4^ [s/zoot4]-L},0)) 

with 1= walking^ <-> walkingj^ and |= alive-\ <-> alive^,, and the equalities teasez = 
teases and shootz = shoots = shoot4. 

In order to correctly make inferences in such a description, it has to take into ac- 
count a solution to the frame problem [90] (cf. Chapter 4). In [2] this is done by pro- 
viding another object containing Successor State Axioms [99] connected with the mod- 
ules above. We do not show this explicitly here and just assume the above description 
together with such a solution provides a way for deriving all frame axioms. Then, 
because the tease action does not change the status of literal ^alive, from the above the- 
ory with its respective solution to the frame problem, we are able to derive the frame 
axiom ^alive — > [tease]^alive . Because we have [tease]walking and walking — > alive, we 
also conclude [tease]alive . Joining these results gives us the implicit inexecutability [42] 
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-^alive — > [tease] J-. That is an intuitive result. However, with this and the executabiUty 
{tease)T, we conclude alive: the turkey never dies (Figure 3.1)! 




Figure 3.1: A model of the immortal turkey. 

The way the proposal in [2] gets rid of such a problem is by imposing a syntactical 
condition on the antecedents of executabilities and effect laws in order to preclude 
them of getting in conflict. Roughly speaking, whenever there is an inexecutability 
cp — > [fl]_L and an executability cp' — > (fl)T, then cp A cp' is inconsistent. So, in order to 
have a safe description, we should change V^^^^j ^^ the following way: 



P ^1 alivej ^ {tease2)T, 
^^^ 1 hasGufij <r^ {shootijT 



,{alwe2})) 



That is to say, decomposing the description in its more elementary entities like we did 
above is not allowed. 



3.3 Strong Logic-driven Modularity 

Some researchers have tried to capture what modularity in formal logic means [38, 
115, 114, 22] at an elementary level. Here we focus on the works of Garson [38] and 
Cuenca Grau and colleagues [22]. 

Inspired by Fodor's claims [34], Garson seems to have been the precursor of 
proposing a notion of modularity in logical systems. In his work, he has given an 
account of modularity motivated especially by issues as correctness and efficiency of 
a reasoning system. 



§3.3 Strong Logic-driven Modularity 27 



In Garson's approach, in order to be a module, a module prototype (alias sub- 
description) must satisfy two properties: 

1. Local correctness: every formula entailed by the sub-description is also entailed 
by the whole description. 

2. Local completeness: every formula in the scope of the sub-description that is 
entailed by the whole description is also entailed in the sub-description alone. 
(A formula O is in the scope of the module V^ = (£i, |=s, 7^) if d) G £i.) 

Local correctness requires the module prototypes to be "smaller" than the original 
description, i.e., given D = (£, |=3,T)andX>' = (£', |=3',T') a module prototype of P, 
we must have £ ' C £, |=s C |=3 and T' C T. (This is indeed our definition of module 
prototype, cf. Definition 3.1. In practice, we should claim for the strict inclusion C, 
since in modularizing a description we generally do not expect to get the original 
description as a result.) To see the need for such a property and the motivation behind 
our definition, if at least one of these inclusions does not hold, then the sub-description 
can prove more things than the whole description, contradicting the intuition of the 
concept of module. 

LetP = (£, 1=3, T) be an action theory and D^ = (£i, |=s,T^), ...,I)^ = (£^, \^>%x) 
be module prototypes of V. Local completeness states that 

r = Ti U . . . U r^, such that Cn[V) = |J Cn[V^) 

^<i<n 

and 

Cn[V^)nCn{V^) =0,Vl,j,l7^ j 

In other words, the collection of all logical modules should be a kind of 'partition' of 
the original logical theory. 

It is not difficult to see that such a notion of modularity in its own is too strong. 
First, because each module's theory 7^ by definition entails all logical tautologies. Sec- 
ond, because it holds only for consistent descriptions: it may be the case that an incon- 
sistent domain description has no module that is itself inconsistent, and then there can 
be formulas entailed by the whole description that are not entailed in their respective 
module, violating local completeness. 

Both these problems have been addressed in [38] and [22]. We can relax local 
completeness by considering only substantive entailments of the theory, i.e., non- 
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tautological ones. In what concerns consistency, Garson argues that classical logic 
is not a good setting for an account of modularity. Besides the complexity of consis- 
tency check, the very main reason for that, he says, is the principle of explosion:^ in 
classical logic, a contradiction entails any sentence, which makes consistency check 
very costly. As a manner of overcoming that and guaranteeing local completeness 
even for inconsistent descriptions, Garson proposes to use relevant logic [30] instead 
of classical logic. Cuenca Grau and colleagues, on the other hand, rely on the tractable 
consistency check methods for description logics [8] and do not care about the princi- 
ple of explosion. 

Nevertheless, even relaxing local completeness, if we apply such a notion of mod- 
ularity to domain descriptions in reasoning about actions, we can have some annoy- 
ances. To witness, consider the following example (we illustrate with PDL, but it 
could also be adapted to other frameworks in the literature that allow for the four 
types of laws that we use to describe dynamic domains): suppose a domain with, 
say, two actions a-\ and az, and only one atom p. Let V = (£pql, |=p„. ,T), with 
T = {p — > [fli]_L,p — > («i )T, (fl2)T}. Notice that V is consistent. So, because actions fli 
and fl2 are independent, i.e., they do not interact one with the other, it is reasonable 
to start by requiring that the laws describing the sub-domain of fl i to be in a separate 
module than those describing the domain of aj- Lets suppose that is the case, i.e., we 
have 2?! = (£pdl, hp^L-'^i) and 2)2 = (-Crdl, ^^l'^^' "^^^^ 




'r^ = < ' '; J },T, = {{a2)T} 



(Note that the description is still consistent.) We point out that such a modularization 
does not satisfy the principle of modularity above: there is a formula, viz. [ajl^p that 
is entailed by the whole description but is not entailed by the module V2 alone. This 
means our decomposition of T> in V-^ and P2 is not good. But where is the problem? 
We said that a-\ and az play no role together. So why 1)2 alone is not enough to derive 
all conclusions in the domain of fl2? Because there is an implicit logical interaction be- 
tween laws for fli and az that cannot be avoided. Zooming in inside T^, we see that 
it entails ^p, i.e., ^p is a static law (hence, valid in every possible state of the world), 
and, because the same happens in T, we have T \=^^ ^p and then T \=^^ [ail^P- Such 
a global implicit entailment "gets lost" when we decompose the description, and that 



^Ex falso sequitur quodlibet, the law of classical logic according to which "anything follows from a 
contradiction." 
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is what makes the result to violate modularity. In order to overcome the problem, we 
should rather join both modules. However, this gives exactly V as result! 

Here we argue that formulas in reasoning about actions are so coupled, so related 
that it is infeasible to have at once local completeness and intelligibility with scala- 
bility. For applications of real interest, modules have to be so huge that we will find 
inside the module the original problem about the initial description: it is big, diffi- 
cult to understand and whose pretended independence from the other modules falls 
down if a change in some other module forces an implicit law. 

To summarize, either sub-domains are put together, giving us huge modules, with 
lots of different types of formulas mixed and whose intelligibility is doubtful, or we 
redefine modularity, probably relaxing it, to allow the (natural and unavoidable) cou- 
pling among different formulas. Here we chose the second way and that is the issue 
we henceforth address. 
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Chapter 4 

where we show how we cut the grass in our garden 



The Modularity's New Clothes 



Take what you can use and let the rest go by. 

— Ken Kesey 

In this chapter, we make a step further through the notion of modularity of an 
action theory and analyze some of its properties. We propose a way to overcome the 
problem of implicit laws that we saw in the last chapter. For the sake of simplicity, 
we suppose that no solution to the frame problem is given. We propose algorithms 
to check whether a given action theory has implicit laws and that also catch them. 
Completeness, correctness and termination results are demonstrated. 

4.1 A Natural Decomposition 

We start by observing that it is often the case that a set of axioms T containing multiple 
modalities a-\,a2, . . . can be naturally partitioned into a union of theories T^ U T^^ U 
T''^ U . . . such that T^ contains no modal operators, and the only modality appearing 
in each T"^ is fli. 

For example, consider an action theory T>^^^-^ = (£pdL) hpQL ' ^) ^""^^ t'^^*- 



r 



-^[married A bachelor) , 

^married — > {marry)T, 

[marry]married 



We can see such a theory as composed of two modules, one for expressing the dynamic 
part of the theory, and another one to formalize the static constraints of the domain. 
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The module 

J -^married ^ {marry)T , 1 

^marriaf;e^ ~ (■'--PDLi Fpr-)| ^ ) (} 

[ [marrylmarned J 

formalizes the behavior of the action of getting married, in this case the precondition 
for executing marry (viz. ^married) and the effect that obtains after its execution (viz. 
married). The module 

T^marriagei = ('CpDL, \j, ^^_,{-^ (married A buchelor)}) 

formalizes the static law according to which it is not possible to be married and bach- 
elor at the same time. 

Let the underlying multimodal logic be independently axiomatized (cf. Sec- 
tion 2.1), and suppose we want to know whether V \= O, i.e., whether a formula O 
follows from the action theory V = (£pdL) Hr,\_>'^)- Then it is natural to expect that 
we only have to consider those elements of T which concern the modal operators oc- 
curring in O. For instance, the proof of some consequences of action fli should not 
involve laws for other actions az- Note that this is not the case if the logic is not inde- 
pendently axiomatized and there are interaction axioms such as [fli]0 — > [flil^- 

Here we propose a modality-based decomposition of an action theory T>. 

Let flct(O) return the set of modal operators (actions) occurring in formula O, 
and, for given V = (£pdL) l=pQ|_)^)/ let act{T) = [j^^^-j- act{0). For instance, 
act([a-\](p-^ — > [azlpz)) ={«i)«2}- For given a g 2lct, we define 

T" = {(!) €T : flct(<D) = {«}} 

For formulas with no modality, we define 

r^={(D gT : flct(O) =0} 



For example, if 



r = < 



-^[married A bachelor) , 
-^married — > {marry)T, [marry]married , 
married — > {divorce)!' ^ [divorce]^married 
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then 

T 



■divorce J "^«''"<^rf — > {dworce)T, 



[ [divorce]^married J 

and 

T^ = {-^(married A bachelor)] 

We henceforth make the following hypothesis: 

{r^} U {T^t : fli G 2lct} partitions^ T (H) 

We thus exclude T"^ containing more than one modal operator. 
Given this, we are now able to formally define modularity of a theory. 

4.2 Modularity 

We are interested in the following principle of modularity: 

Definition 4.1 (Modularity) 

An action theory V = (£pdL) I=pol'^^ is modular if and only if for every formula O, 

P h O implies (£pDL, ^dl-^^ ^ T"''^''^) h O. 

Our notion of modularity means that when investigating whether O is a conse- 
quence of V, the only formulas of V that are relevant are those whose modal operators 
occur in O and the classical formulas in T^. 

This is reminiscent of interpolation [21], which more or less^ says: 

Definition 4.2 (Interpolation property) 

An action theoryV = (£pdL) I=pol' -^^ ^^^ the interpolation property if and only if for 
every formula O, ifV \= €>, then there is a module V^ = (£pdl , hp^L > ^o) ^"<^^ ^^^^ 

• act[T^) Cact{T]r\act[^); 

• V ^ O' for every O ' G T^^; and 



HT®} U {T"i : flt G act} partitions T if and only if T = T® U Unread "^"^ and T® n T"* = 0, and 
T"' n T") = 0, if fli / flj . Note that T® and each T"* might be empty. 

^We here present a version in terms of global consequence, as opposed to local consequence or mate- 
rial implication versions that can be found in the literature [69, 70]. We were unable to find such global 
versions in the literature. 
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Our definition of modularity is a strengthening of interpolation because it requires T^ 
to be a subset of T. Properties similar to interpolation for reasoning about actions in 
PDL have also been investigated in [120]. 

Contrary to interpolation, modularity does not generally hold. Clearly if the 
Hypothesis (H) is not satisfied, then modularity fails. To witness, consider T> = 

{CpDL,^Q^_,'^) such that 

T ={p^ ^ [fll][fl2]P2' [«i][«2]p2 -^ P3} 

Then P h Pi ^ P3' but (£pdl, ^du'^^ ^ T^^'^P^^P^^) \^p,^ p,. 

Nevertheless, even under our hypothesis, modularity may fail to hold. For exam- 
ple, let P = (£pDL,l=pDL,'?') be such that 

r = {-p^ [a]±,^p^ {a)T] 

Then T^ = 0, and T" = T. Now V ^ p, but clearly (£pdl, ^^l ' ^^ ^ T"^*'?') ^ p. 

How can we know whether a given action theory V is modular? The following 
criterion is simpler: 

Definition 4.3 (Propositional modularity) 

An action theory V is propositionally modular if and only if for every propositional 
formula (p, 

P h (P implies (£pDL, ^dl'^^) ^ ^ 

And that suffices to guarantee modularity: 

Theorem 4.1 

Let the underlying logic be a fusion, and let V = (£pdL) hpQL > '^) ^^ such that T is 
partitioned. IfV is propositionally modular, thenV is modular. 

Proof: 

See Appendix A. ■ 

In the rest of the chapter, we investigate how it can be automatically checked 
whether a given action theory V is modular or not, and how to make it modular, 
if needed. 
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4.3 Deciding Modularity 

How can we check whether a given action theory V is modular? Following Theo- 
rem 4.1, it is enough to check for propositional modularity. 

Definition 4.4 (Implicit static law) 

cp G "Sml is an implicit static law of an action theory V if and only if V \= cp and 

Let I^frans = ('CpDL) hpni > '^) formalize a transaction domain such that: 

J ^adult — > ^obligedPay, [order]obUgedPay, 1 
[ -^adult ^ [order]^adult,{order)T J 

Observe that by the fact that ^'f^-a^g 1= ^adult — > [order] _L, we have I'frans 1= «rfw/f. But 
T® ^ fldw/f, hence adult is an example of an implicit static law . Moreover, X'jrons i^ 
also an example of an action theory that is not modular in our sense. 

Theorem 4.1 tells us that an action theory is modular if and only if it has no implicit 
static law. Hence, checking the existence of such laws provides us a way to decide 
modularity of a given action theory. Assuming the theory component T of an action 
theory is finite, with Algorithm 4.1 below we can check whether an action theory 
has such implicit laws. The idea is as follows: for each pair of laws cpi — > (fl)T and 
(P2 — > [fl]-L in T, if (pi A (p2 is satisfiable and T^ ^p^ -■(cpi A (pj), rnark -'(cpi A (pj) as 
an implicit static law. 

Algorithm 4.1 Deciding existence of implicit static laws 

input: V = {£poL,'^^^_,T) 

output: a set of implicit static laws Sjmp 

'^imp • ~ W 

for all fl G act[T) do 

for all cp'^ (fl)T G T do 

for all {(pi -> [a]\\)^, . . . , (pn -> [fl]i|)n} ^ T" do 

if r^ U {(p ', cpi , . . . , (p^} ^PL ± and r^ U {^1 , . . . , ^^} ^p^ ± then 
.Simp : = 5/mp U{-((p' A cpi A... Acp,^)} 

Theorem 4.2 (Decidability) 

Algorithm 4.1 terminates. 

Proof: 

Straightforward from finiteness of T. ■ 
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Theorem 4.3 (Soundness) 

Let Simp be the output of Algorithm 4.1 on input V = (£pdli \j,q^_ , T)- Then every 
cp G Simp is an implicit static law ofD. 

Proof: 

Let cp G S'mtbe such that cp G Simp and D |= ^P- ^P is of the form -■ ( cp ' A cp i A. . . Acp^), 
for some cp', cpi , . . . , cpn, and T® U {cp' A cpi A ... A cpn} ^p,^ -L is the case. Hence, 
T'^ U{-'(p} ^ ±, which means that T^ ^ cp. Therefore cp is an implicit static law. ■ 

Remark 4.1 The converse of Theorem 4.3 does not hold: consider the quite simple 
action theory V = (£pdl, hp^L > ^) such that 

1 Vi-^ -^ WPi- 1 < -L < n J 
Thus, V \= -'p^, for < i. < n, but running Algorithm 4.1 returns only Simp = {~^Pn-^}■ 

This suggests that it is necessary to iterate the algorithm in order to find all implicit 
static laws. We shall do this in the sequel, and now just observe that: 

Theorem 4.4 

Anaction theoryV = (£pdL) hp^L,^) is modular if and only if Simp = 0- 

Proof: 

See Appendix A. ■ 

Considering the action theory in Remark 4.1, we see that running Algorithm 4.1 

on (£pDL, hpDL > ^ '-' {^Pn-J) gi^es us Simp = {~'Pti,-2J^- ^^^^ means some of the implicit 
static laws may be needed in order to derive others. Hence, Algorithm 4.1 should be 
iterated to get T> modular. This is achieved with Algorithm 4.2, which iteratively feeds 
the set of static laws considered into the if-test of Algorithm 4.1. 

Algorithm 4.2 Finding all implicit static laws 

input: V = (£pdl,^dl'^^ 

output: Simp*, the set of all implicit static laws of V 

•Simp* '■ = 

repeat 

Simp '• =findJmp_stat[{€.pD\_ , \=^^ , T U Simp*)) {a call to Algorithm 4.1} 

Oimp* • ~ <Jimp* U '^imp 
until Simp = 
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Theorem 4.5 (Decidability) 

Algorithm 4.2 terminates. 

Proof: 

First, for given a the set of candidates to be an implicit static law is 

{-(cp A /\ (pO : (p ^ («)T G r" and f" C T"} 

This set is finite. 

In each step, either the algorithm ends because Sjmp = 0, or at least one of the 
candidates is put into Sjmp (by a call to Algorithm 4.1, which terminates). Such a can- 
didate is not going to be put into 5„„p in future steps, because once added to Sjmp*, it 
will be in the set of laws of all subsequent calls to Algorithm 4.1, falsifying its respec- 
tive if-test for such a candidate. Hence the repeat-loop is bounded by the number of 
candidates, and therefore Algorithm 4.2 terminates. ■ 

Theorem 4.6 

Let Simp* be the output of Algorithm 4.2 on input V = {^pdl,\^q^_,'^)- Then 

1- (-CpDL , hpDL , ^ U Simp*) is modular. 

■2- ^ 1= A 'Simp*- 

Proof: 

Item 1. is straightforward from the termination of Algorithm 4.2 and Theorem 4.4. 
Item 2. follows from the fact that by the if-test in Algorithm 4.1, the only formulas 
that are put in Simp* at each execution of the loop are exactly those that are implicit 
static laws of the original theory. ■ 

Corollary 4.1 

LetV = (£pDL, ^PDL''^)- Porall cp G ^ml X* h <P if and only if T'^ U Simp* hgp|_ <P- 

Proof: 

For the left-to-right direction, let cp G S^ml be such that V \= (p. Then T \= cp, and 
hence T U Sjmp* hp^^ 'P/ by monotonicity By Theorem 4.6-1., (£pdl > hp^L > '^ U Simp*) is 
modular, hence T^ U Simp* l=gp, ^P- 

The right- to-left direction is straightforward by Theorem 4.6-2. ■ 

This establishes that Algorithm 4.2 finds all implicit static laws of an action the- 
ory v. Adding such laws to the theory component T oiV guarantees, hence, modu- 
larity of v. 
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4.4 What about the Frame Problem? 

As the reader might have already expected, the formalism of PDL alone does not solve 
the frame problem [90]. For instance, if D^^jg describes our shooting domain (cf. Sec- 
tion 2.3), then 

"^wts V= hasGun — > [load]hasGun. 

The reason is that there are some anomalous models in which hasGun is not preserved 
after the execution of action load. The model in Figure 2.3 is an example of an anoma- 
lous model for such a scenario. Figure 4.1 highlights one of its problematic transitions. 




Figure 4.1: Anomalous model in the Walking Turkey Scenario. 



The formula hasGun — > [load]hasGun is an example of a frame axiom. Following 
the tradition in the reasoning about actions community, we do not want to state such 
a kind of axioms in the action theory. In order to satisfy this requirement, given an 
action theory V, we need a consequence relation powerful enough to deal with the 
frame problem. This means that the deductive power of PDL has to be augmented in 
order to ensure that the non-effects of actions follow from the theory. We here opt for 
the dependence-based approach presented in [14]. There, meta-logical information, 
given in the form of a dependence relation, is added to PDL. 



S4.4 What about the Frame Problem? 39 



Definition 4.5 (Dependence relation [14]) 

A dependence relation is a binary relation -^ C 2lct x £it. 

The expression a ^^ i denotes that the execution of action a may make the literal i 
true. In our example, we have 

{{shoot, ^loaded), {shoot, ^alive), 1 
{shoot, ^walking), {tease, walking) J 

which means that action shoot may make the literals ^loaded, ^alive and ^walking true, 
and action tease may make walking true. 

Semantically, the dependence-based approach relies on the explanation closure 
assumption [102], and its solution to the frame problem consists in a kind of negation 
as failure: because {load,^hasGun) ^ '^, we have load -/> ^hasGun, i.e., ^hasGun is 
never caused by load. Thus, in a context where hasGun is true, after every execution 
of load, hasGun still remains true. We also have tease -/> alive and tease -/> ^alive. The 
meaning of all these independences is that the frame axioms hasGun — > [load]hasGun, 
-^alive — > [tease]-^alive and alive — > [tease]alive hold. 

We assume that ^^ is finite. 

A dependence relation ^^ defines a class of possible worlds models: 

Definition 4.6 (^^ truth conditions) 

A PDL-model ^ = {W,R) is a -^ -model if and only if whenever wRaw' then: 

• ifa^ p, then \f^ p implies \^,p; and 

• ifai^ -^v, then \= p implies ^ p. 

Figure 4.2 depicts the dependence-based condition on models. 

Given a '^-model ^, O and T,\^ O and |= T are defined as in Definition 2.3. 

Definition 4.7 (^^-based logical consequence) 

A formula O is a ^^-based consequence of the set of global axioms T in the class of all 
-^-models (noted T ^ (t> ) if and only if for every -^ -model. y^ , if \= T,then\= O. 

Thus, if in our example we replace in V^^^ the consequence relation |= , with its 
associated dependence relation above, for kp,, , it holds: 

T^iuts 1= hasGun — > [load]hasGun . 

In this way, the dependence-based approach solves the frame problem. 
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Figure 4.2: Dependence-based condition: preservation of literal -^-p under hypothesis a 7^ 



Henceforth we consider \^ as the consequence relation component of our PDL 
domain descriptions. 

Definition 4.8 (Action theory model) 

LetV = (£pDL) 1= ,T) be a domain description. A PDL-model M is a model of V if 
and only ii M is a -^ -model and |= T. 

All the definitions we have given in this chapter shall then be adapted to fit to- 
gether with our new consequence relation. We will develop this issue later on in this 
work. Before doing that, in the next two chapters we investigate interesting properties 
that justify our choice for the dependence-based approach. 



Chapter 5 

where we show we can do as simple as others 



Recasting Reiter's Solution 



Almost all absurdity of conduct arises from the 
imitation of those whom we cannot resemble. 

— Samuel Johnson 



In this chapter, we propose an encoding of Reiter's Situation Calculus solution to 
the frame problem into the framework of our multimodal logic of actions. In par- 
ticular, we show that with the dependence-based solution to the frame problem we 
achieve that without quantification, and present the modal counterpart of the regres- 
sion technique. This gives us a theorem proving method for a relevant fragment of 
our dynamic logic. 



5.1 Deterministic PDL with Quantification and Equality 

In the reasoning about actions field, most approaches use the Situation Calculus for- 
malism [90]. Among those, Reiter's [99] has turned out to be most fruitful. His basic 
formalism is restricted to deterministic actions without static laws. In order to solve 
the frame problem, he makes use of so-called Successor State Axioms (SSAs). The 
latter enable regression [99], which has interesting computational properties. 

The Situation Calculus is a dialect of predicate logic, having situations and actions 
as objects, and where actions are viewed as mappings on the set of situations. At first 
glance, this is very close to possible worlds semantics for deterministic PDL [49]. But 
the precise relation between Reiter's approach and dynamic logic is not as obvious 
as that. One of the reasons why his formalism cannot be translated straightforwardly 
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into modal logics of action such as PDL is that the Situation Calculus allows quantify- 
ing over actions. Worse, such quantifications are central to Reiter 's approach. 

In [24] there has been presented a technique to translate Reiter 's framework into 
dynamic logic. In this chapter we present a different approach. We solve the problem 
using the dependence-based extension to PDL that we saw in the previous chapter. 
Having such a result provides some degree of optimization in doing inference tasks 
for some important classes of problems in the area. 

In this chapter, we will concentrate only on deterministic PDL, i.e., the logic we 
have defined in Chapter 2 restricted to the case where each Ra is deterministic: for each 
action a and each world w, there is at most one world w' such that wRaw'. Moreover, 
we here slightly extend such a logic in order to allow for quantification over actions 
and the equality predicate. This will serve as the basis for developing the ideas in this 
chapter. 

We here will use a as a meta-variable ranging over action constants and vari- 
ables. Here O will also denote complex formulas possibly involving quantification 
and equality between actions. 

The nonstandard feature of the logic we are going to use here is that we allow 
for quantification over actions, and for equality between actions. Hence, in this version of 
dynamic logic, we allow for formulas of the form Vfl.O, with O a complex formula. In 
the Yale shooting scenario (YSS) [47], one can e.g. write 

ya. [alive A^[a]alive — > (a = shoot A liasGun A loaded)). 

This is an explanation closure axiom [102] expressing that the only way to make alive 
false is by the shoot action under preconditions hasGun and loaded. 

We call our version of deterministic PDL with quantification and equality DPDL"*". 

Once added these features to deterministic PDL, it remains to redefine what its 
models are. 

Definition 5.1 (DPDL+-model) 

A DPDL^-model is a triple ./^ = {W,RJ) where W and R are as in Definition 2.1, 
and I is an interpretation function mapping propositional constants to subsets of W, 
and action constants and variables to elements ofR. 

We will sometimes write w' € (7(a) ) (w) instead of wl{a)w', and similarly for vari- 
ables a. 
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Definition 5.2 (Interpretation agreement) 

Let I and I' be interpretations. I agrees with I' except possibly on a if and only if 

• I(p) = l'{p),foreverypropositionalconstantp; 

• I[a) = I' [a), for every action constant a; and 

• I{a') = I' [a'), for every action variablea' different from a. 

For a DPDL+-model .^ = (W,R,7), ^Vfl.<D if and only if for every I' such that I 
agrees with I' except possibly on «, |=i ' ' O. |^ [fl]0 if and only if for every w' G 
(7(fl))(w), h ,^- 1= [fl]0 if and only if for every w' G {I{a))[w), ^ ,0. The other truth 
conditions, truth in a model and logical consequence are as defined in Section 2.1. 

Actions being deterministic, i.e., (/(«)) (w) is either a singleton or empty, we have 
that for every action constant a and every formula O 

If all actions are deterministic, then every formula without quantification can be 
brought into a normal form where there are neither conjunctions nor disjunctions in 
the scope of modal operators. Apart from classical equivalences, this uses the follow- 
ing ones from the left to the right: 

^p^^^ [fl]((DA(D')^(raoA[fl](D') (5.2) 

^p^^^ [fl]((DV(D')f^(raoV[fl1(D') (5.3) 

In the next section, we introduce the basic hypotheses concerning the knowledge 
we have about actions. 



5.2 Describing Actions Like Reiter 

In describing an action theory, it is more or less explicitly supposed that the following 
pieces of information are given. (Some assumptions of complete information are made 
about them.) 

For each action constant «, there is a classical formula Poss{a) describing the action 
precondition of a, i.e., the condition under which a can be executed. For example, 

Poss[shoot) = hasGun, and Poss [strangle) = T. 
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It is supposed that action preconditions are complete: a is executable if and only if 
Foss{a) is true. In terms of dynamic logic, completeness of action preconditions means 
that for every a E 2lct, we have a global axiom: 

Foss[a] f^ -[fll_L (5.4) 

For each propositional constant p, there are two finite sets of action constants 
causes~^{p) and causes~[p], describing, respectively, the positive and negative causes 
of p. The set causes~^{p] contains the actions in 2lct which in some circumstances 
might cause p to become true, while causes~(p) contains those actions that may 
cause p false. For example, causes'^ [alive) = (no action makes an agent alive), 
causes~ [alive) = [shoot, strangle}, and causes~ [loaded) = {shoot}} 

It is also supposed that causes~^[p) and causes~[p) are small, in the sense that 
causes^[p) and causes~[p) are much smaller than 2lct. 

Moreover, we suppose that these two sets are complete: whenever a ^ causes~^[p), 
then the execution of a can never make p true. In terms of dynamic logic, causal com- 
pleteness means that we have a global axiom -^p — > [a\^p in that case. Similarly, for ev- 
ery fl such that a ^ causes~[p) we have a global axiom p — > [a ]p. These are frame ax- 
ioms. In our example, as strangle ^ causes~ [loaded), we have loaded — > [strangle]loaded. 
This corresponds to the explanation closure assumption [102, 103]. 

For all propositional constant p £ *prop and every action constant a G causes~^[p), 
there is a classical formula Cond'^[a,p) describing the positive effect precondition of ac- 
tion a. As an example, Con(i'''(to^g/e, up) = ^up, and Cond~^ [load, loaded) = T. Simi- 
larly, for every a G causes~[p), there is a Cond~[a,p) describing its negative effect precon- 
dition. For example, Cond~ [strangle, alive) = T, and Cond~ [shoot, alive) = loaded?- 

It is supposed that effect preconditions are complete: in situations where the for- 
mula Cond~^[d,p) does not hold, the execution of a can never make p true. Symmetri- 
cally, when Cond~[a,p) does not hold, then the execution of a can never make p false. 

In terms of dynamic logic, to every effect precondition Cond~^[a,p), one can asso- 
ciate a global axiom Cond~^[a,p) — > [a]p, and to every effect precondition Cond~[a,p), 
one can associate a global axiom Cond~[a,p) — > [d]^p. As an example, we have the 
formula loaded — > [shoot]^alive. 

Completeness of effect preconditions means that we moreover have a global axiom 
[^Cond~^[d,p) A^p) — > [a]^p for every a G causes~^[p). Symmetrically, for every a 



'in Reiter's presentation, these functions can be retrieved from his functions y^ and y [100]. 
^These functions correspond to Reiter's y^ and y^ . 
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such that a G causes~ip), we have a global axiom [^Cond~(a ,p) Ap) — > [a]p. This 
expresses in dynamic logic what Reiter calls the application of Clark completion [18]. 
For example, we have (^loaded A alive) — > [shoot]alive. In [14], axioms of this form 
are called conditional frame axioms. There they are needed to complete the dependence 
relation so that we can capture context-dependent effects of actions. 

The three pieces of information together with the completeness assumptions guar- 
antee that the possible world resulting from the execution of action a in a possible 
world w is completely determined: for every model ^ = {W,R,I) and every world 
w G W, if ^ Poss[ii), then [I[a)){w) = 0. Else, the truth value of every p in every w' 
accessible from w via I{a) is as follows. Suppose w.l.o.g. that |= p. Then: 

• if fl ^ causes~{p), then |= ,p; 

• if fl G causes~{p) and ^ Cond~{a,p], then |= ,p; and 

• if fl G causes~{p) and ^ Cond~{a,p), then \^,p. 

As all truth values are thus determined, it follows that the set of worlds accessible 
via I{a) is either empty, or it can be considered to be a singleton. This fits with the 
assumption that all actions are deterministic. 

As we have noted, the action preconditions and effect preconditions appear ex- 
plicitly in Reiter's formalization, while the sets of possible causes causes~^(p) and 
causes~ip) only appear implicitly there. 

Note that in Reiter's Situation Calculus it is supposed that actions always lead to 
some state: even in states where the agent has no gun in his hands, the state resulting 
from the execution of shoot exists. The technical reason is that just as every function 
in predicate logic, his successor function do(.) is total. This means that the logic of 
each action operator [a] should be KD [16]. We have nevertheless decided to follow 
the dynamic logic tradition and suppose that the set of worlds accessible via some 
action a might be empty. Therefore the logic of each [a\ is just K. 

In fact, inexecutability of the action shoot is expressed in Situation Calculus by stat- 
ing Poss(shoot) f-> hasGun, where Poss[shoot) is a particular propositional constant. In 
our formulation, Poss (.) is a function associating a classical formula to every action a. 
Poss[a) can be seen as an abbreviation, such as Poss{shoot) = hasGun. Given a domain 
description in Reiter's style, we obtain a description in our style if we 

• Define our Poss(fl)-function from Reiter's preconditions Poss(fl) <-> cp; and 
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• Replace Reiter 's constants Poss[a) by our {a)T. 

The other way round, our version can be translated to Reiter 's by 

• Defining his preconditions Poss(fl) <-> cp from our Poss (a) -function; and 

• Recursively replacing [a\(p hy Poss[d) — > [a](p. 

Observe that the latter is nothing but the well-known translation from modal logic K 
to KD [93, 94]. 

All this sounds as if action theories could be described in DPDL"'' in a satisfactory 
manner, but, in such a framework, we have not solved the frame problem yet: as by 
hypothesis causes~^{p) and causes~{p) are small, it follows that the size of the set of 
frame axioms that we have to state is close to cflrd(^rop) x cflrd(2lct). This is usually 
considered to be too big, and a central element in the research program of the reason- 
ing about actions community was to design mechanisms allowing to infer such frame 
axioms without stating them explicitly. 

There was a 20-years-long debate about semantics and theorem proving methods 
allowing such inferences. Reiter 's proposal seems to have closed the debate at least in 
what concerns deterministic actions and no static laws. This is going to be presented 
in the sequel. 

5.3 Reiter's Solution to the Frame Problem 

Based on a particular class of models, Reiter proposes to incorporate the basic ingre- 
dients of action theories that we have presented in the preceding section into what he 
calls Successor State Axioms (SSA) [99]. These are special formulas that, given a state 
and an action, completely determine the next state. 

Reiter requires that all object names in the domain signature are unique and that 
models are trees. 
Definition 5.3 (Reiter model) 

A DPDL+-modei ^ = {W,R,I) is a Reiter-model if and only if {W, Uoesict ^«) ^^ ^ f^^^' 
and ifl(a\) = I{dj), then i = j. 

Figure 5.1 illustrates the tree-like structure of a Reiter model. 

Definition 5.4 (Reiter's logical consequence) 

A formula O is a Reiter consequence of ttie global axioms T in tfie class of all Reiter- 
models (noted T |= Oj if and only if for every Reiter-model J( , if |= T , then |= O. 
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Figure 5.1: Structure of a Reiter-model. 

Successor State Axioms 

Suppose that all the Poss(.), causes "*"(.), causes~[.), Cond'^i.) and Cond~i.) are given, 
and that the completeness assumptions are made. We then can associate with that 
an action theory V^ = (£dpdl+ > 1^'^) from which the relevant frame axioms will 
follow. According to Reiter's approach, the component 7^ of the description is made 
up of the following axioms: 

• for every a £ 2lct, there is an executability axiom Poss[d) <-> ^[fll-L; and 

• for every p € *prop, if causes """(p) = {a i, ... ,an,} and causes ~(p) = {a^,...,a^}, 
then there is a Successor State Axiom 

ya.[[a]p <-> 

(-Poss(a) V 

[a = a-[ ACond~^[a'\,p)) V ... V (a = Un A Cond~^ {an,p)) V 

(p A-'(a = a\ ACond~{a\,p)) A . . . A^(a = a!^ A Cond~{a[y^,p))))) 



Note that the Successor State Axiom above is well defined because we have supposed 
that causes~^{a) and causes~{a) are finite. 

For the cases where n = or m = 0, conjunction of the elements of an empty set 
is identified with T, and disjunction with _L. The latter can be illustrated with our 
running example, where causes'^ [alive) = 0. The Successor State Axiom for alive is: 

ya.{[a]alive <-> 

i^Possia) V _L V {alive A^[a = shoot Aloaded) A^(a = strangle AT)))) 

We abbreviate reg(a,p] the right hand side of such an equivalence. The Successor 
State Axiom for p therefore has the form ya.i[a]p <-> reg(a,p)). 
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Successor State Axioms can be equivalently stated for negative literals as: 

Vfl.([fl]-'p <-> 

[^Poss[a) V [a = a\ ACond~{a\,p)) V . . . V (« = a!^ A Cond~{am.,p)] V 

i^p A-'(fl = fli ACond~^[a'\,p)) A . . . A^{a = anACond~^{an,p))))) 

We abbreviate reg(a, -^p) the right hand side of this equivalence. For example the Suc- 
cessor State Axiom for -^alive is: 

ya.[[a]^alive <-> 

(^Poss(a) V (a = shoot A loaded) V (a = strangle AT) V {^alive A^±))) 

Reiter's original Successor State Axiom [99] is slightly different from ours: 

ya.[Poss{a) — > {[a]p <-> 

{[a = fli ACond~^{a],p)) V . . . V (« = anACond~^{an,p)) V 

(p A-'(fl = a\ ACond~[a\,p)) A . . . A^(a = a!^ACond~{a!^,p))))) 

Our version can be proved to be equivalent to his: 

Theorem 5.1 

LetT be the set of global axioms (5.4)-(5.8). Then 

T ^^pD|_+ (Vfl.(Poss(fl) -^ [{a\p f^ 

[[a = fli ACond'^{a\,p)) V . . . V (fl = anACond~^[an,p)) V 

(p A^(a = a\ ACond~{a\,p)) A . . . A^{a = a!^ A Cond~ {a[y^,p))))))) 

(Vfl.([fl]p f-> 

(-Poss(fl) V 

[a = fli ACond~^[a],p)) V . . . V (fl = anACond~^{an,p)) V 

(p A-'(fl = a\ ACond~{a\,p)) A . . . A^{a = a!^ A Cond~ {a[y^,p)))))) 

Proof: 

See Appendix B. ■ 

In [100], Reiter excluded the precondition Poss{a) from SSAs, and then just writes 

Vfl.([fl]p <-> 

((fl = fli ACond~^{a],p)) V . . . V (fl = anACond~^[an,p)) V 

(p A-'(fl = a\ ACond~[a\,p)) A . . . A^[a = a!^ A Cond~ {a!^,p)))) 

Therefore we would have e.g. [shoot]^alive <-> (loaded V (^alive A ^-L)), from which 
it follows by classical principles that (^hasGun A alive A [shoot]^alwe) — > loaded. 
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This means that such SSAs do not take into account inexecutability: this issue must 
be managed "by hand" by introducing Poss[shoot) atoms in the right places when 
proving consequences of SSAs in their recent version. 

Finally, we note that Reiter's presentation also contains precondition axioms of 
the form Poss(a) <-> cp. This is not needed here because we view Poss{.) as a function 
returning a classical formula cp, which is directly integrated into our Successor State 
Axiom (cf. Section 5.2). 

Reiter's Regression 

Successor State Axioms are crucial when it comes to the reasoning aspect of the frame 
problem, to which we turn now. 

Given a Reiter's style action theory V^, what can be deduced from it? Suppose 
that O is a complex formula without quantification, action variables, and equality, 
such as, for example, hasGun — > [load][shoot]^alwe . In order to decide whether V^ \= 
<1>, Reiter proposes to rewrite <!> using the Successor State Axioms from the left to 
the right. This is what he calls regression, and it consists in syntactical substitutions 
whose iteration reduces a given formula with action symbols into another one with 
just propositional constants. The whole procedure is given in Algorithm 5.1. 

At each regression step, we have to put formulas in normal form such that there are 
neither conjunctions nor disjunctions in the scope of modal operators (using the hy- 
pothesis that all actions are deterministic). Hence the innermost modal operators have 
just literals in their scope. For the above example, O gets ^hasGun V [load] [shoot]^alwe. 

Algorithm 5.1 Reiter's regression 

input: a DPDL"*" formula O with no variables, Poss{.), causes~^(.), causes~{.], Cond~^{.] 

and Cond~[.) 
output: a classical formula regression ( O ) 
while O is not classical do 
put d) in normal form 
choose a subformula [a](. 
iii = p then 

replace [d\p by reg{a,p) 
else 

replace [a]^p by reg(a, ^p) 

Notice that the action variable a of the Successor State Axiom is instantiated by the 
constant denoted by a. 
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In our example, the regression of the subformula [shoot]^alive is 

-^hasGun V {shoot = shoot A loaded)V 
[shoot = strangle A T) V [^alive A -'_L) 

This can be simplified to ^hasGun V loaded V ^alive. Hence the result of a one step 
regression of O is -^hasGun V [load] {^hasGun V loaded V -^alive). 

Each rewriting step thus eliminates a modal operator, and iterated application re- 
sults in a formula without modal operators. If we iterate regression in our example, 
we first put the formula 

-^hasGun V [load] {^hasGun V loaded V -^alive) 

into normal form, obtaining 

-^hasGun V [load]^hasGun V [load]loaded V [load]^alwe . 

The regression of subformula [load]^hasGun is equivalent to ^hasGun, that of subfor- 
mula [load]loaded to T, and that of [load]^alwe to ^alive. We therefore obtain 

-^hasGun V -^hasGun V T V -^alive, 

which is valid in classical propositional logic. This means that the original formula 

hasGun — > [load] [shoot]^alive is entailed by V^^. 

As regression is proved to be sound [100, Theorem 4.5.2], checking validity of the 
original formula amounts to checking satisfiability of the regressed one in the initial 
state of the world: 

Theorem 5.2 ([100]) 

Let Pr be a Reiter style domain description, and (t> be a formula without variables. 
Then P^ |= <!' <-> regression ( O ) . 

Corollary 5.1 

Dp; 1= ® it and only if [=p^ r egression [O). 

In the rest of this chapter, we explore whether regression can be performed in a 
simpler framework, in particular without quantifying over actions. 
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5.4 Solving the Frame Problem without Quantification 

The venue of Reiter's Situation Calculus-based solution has raised the natural ques- 
tion of at what extent it could be possible to do the same in dynamic logic. Given 
the expressivity limitations of the latter w.r.t. first-order logic (originally it did not al- 
low for quantification over actions), many researchers [119, 120] have turned to other 
ways of facing the problems in the area. There has been others [23], however, who 
have tried on the first steps in that direction. 

We here give DPDL"'' up and consider just deterministic PDL and possible exten- 
sions of it in order to encode Reiter's solution to the frame problem. 

De Giacomo and Lenzerini's Encoding into PDL 

De Giacomo and Lenzerini [23] have expressed Reiter's solution in a slightly modified 
version of PDL that avoids quantification over actions. For the sake of presentation, 
here we simplify their account a bit. Basically, their approach can be said to have the 
following ingredients (a denotes a complex action, i.e., an action built up on atomic 
actions and PDL classical action composition operators): 

• nondeterministic choice a U a'; 

• converse a~; 

• a particular nondeterministic atomic action any, thought of as the nondetermin- 
istic composition of all atomic actions of 2lci: any = a-\ U fl2 U . . . U Art; and 

• complement -■a w.r.t. any, where oc = a-\ U . . . U a-m., for some fli , . . . , flrn, £ 2lci. 

Moreover, it is supposed that the past is deterministic, as expressed by the logical 
axiom -'[any ~]^0 — > [any~]0. 

Considering our running example, its formalization in De Giacomo and Lenz- 
erini's framework would be: 

[any][^alive — > {a.ny~)^alive V {shoot~)loaded V {strangle~)T) 

[ciny][alive — > (any~)fl/roe) 

Just as for PDL, reasoning in De Giacomo and Lenzerini's logical framework is 
EXPTIME-complete [23]. While their encoding certainly preserves the spirit of Re- 
iter's Successor State Axioms, they did not give the counterpart of Reiter's regression. 
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and hence did not investigate whether reasoning for syntactically restricted theories is 
"cheaper" than exptime. In what follows, we show how this can be simulated with- 
out quantification in the dependence-based framework we introduced in Chapter 4. 

Regression in PDL plus Dependence 

We start by observing that stating a ^ p in the dependence-based framework is just 
another way of writing down that a £ causes~^{p), and a-^ ^p that a € causes~{p). 

Suppose all the ingredients Poss[.), cawses "•"(.), causes~i.), Cond~^i.), Cond~{.) are 
given, and let us make the completeness assumptions as introduced in Section 5.2. 
We construct a dependence relation and a set of global axioms T as follows: 

• for each p e ^top: for every a G causes~^{p), we put a -^ p; and for every a' G 
causes~(p), we put «' ^^ ^p; 

• for every a € 2lct, add the executability axiom Poss(a) <-> ^[a]-L to T 

• for every p G ^top and every a G causes~^ip), add two effect axioms to T: 

Cond~^{a,p) — > [a]p (5.5) 

{^Cond~^(a,p] A^p) — > [a]^p (5.6) 

• for every p G ^top and every a' G causes~[p], add two effect axioms to T: 

Cond~{a' ,p) — > [fl']-'p (5.7) 

(-Cond"(fl',p) Ap) -^ [a']p (5.8) 

Note that these axioms do not resemble Successor State Axioms. They nevertheless 
validate the same regression principle as in Reiter 's framework, as it will be shown in 
the sequel. 

A point that bears noting is that our representation indeed counts as a solution to 
the frame problem: the sets^^ and T are both "small" (in the sense that we can expect 
they are much smaller than card(^w^) x card(%ti)), and contain no frame axioms. 

Now we turn to an important result: 
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Theorem 5.3 

Let the underlying logic be deterministic PDL^ -^ be a dependence relation obtained 
from sets causes~^{.) and causes~[.), and let T be the set of global axioms (5.4)-(5.8). 
Then 

(1) T [^ [a]p f-> -^Poss[a) V p, if a -/> p and a 7^ ^p; 

(2) T [^ [a]p^^Poss[a)V[pA^Cond~[a,p)),ifa^panda-^^p; 

(3) T [^ [a]p <-> -^Poss(a) V Cond~^[a,p) V p, if a -^ p and a -/> -■p; and 

(4) T [^ [a]p<r^^Poss[a)VCond~^(a,p)\/[pA^Cond~{a,p)),ifa-^panda'^^p. 

Proof: 

See Appendix B. ■ 

Based on this result, with Algorithm 5.2 we give a regression method for deter- 
ministic PDL with a dependence relation. (Let us consider Cond(a,(.) = Cond~^ia,p), if 
£ = p, and Cond[a,i) = Cond~{a,p), if £ = -■p.) 

Algorithm 5.2 Regression with dependence 

input: a PDL formula O, Poss{.], cflMses "*"(.), causes~{.), Cond~^{.) and Cond~[.) 
output: a classical formula regression ( O ) 
while O is not classical do 
put O in normal form 
choose some subformula [a](. 
case fl -/> £ and a 7^ -■£ 

replace [a]t by ^Poss(a) V £ 
case fl -/> £ and a ^^ -■£ 

replace [a]iby^Poss(a) V {I A^Cond[a,^l)) 
case fl -^ £ and a 7^ -■£ 

replace [fl]£by-'Poss(fl) V Cond{a,i) V£ 
case fl -^ £ and a^^ ^i 

replace [fl]£ by -Poss(fl) V Cond(a, i]V[tA -^Cond{a,^i] ) 

Suppose d) is a complex formula without quantification and equality, such as 
hasGun — > [load][shoot]^alive. Then, running Algorithm 5.2 on O, the regression of 
[shoot]^alive is ^hasGun V loaded V ^alive. Hence the result of this regression step is 
hasGun — > [load] [^hasGun V loaded V -^alive). Putting this into normal form using ax- 
iom (5.3), we obtain the formula hasGun — > ( [load]^hasGunV [load]loadedV [load]^alive) . 
The regression of [load]^hasGun is ^hasGun, that of [load]loaded is T, and that of 
[load]-^alive is ^alive. We therefore obtain hasGun — > {-^hasGun V T V ^alive), which is 
valid in classical propositional logic. 
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Theorem 5.4 (Decidability, soundness and completeness) 

LetT and-^ be obtained from Poss[.), causes~^{.), causes~{.), Cond'^{.) and Cond~{.], 
and let O be a complex formula. Then, Algorithm 5.2 terminates returning a classical 
formula cp and T \= O <-> cp. 

Proof: 

Let O be an input formula. Termination is straightforward, as eacli step of tlie al- 
gorittim eliminates exactly one modal operator. Soundness and completeness are 
also immediate: after putting formula O in normal form, it will be made of conjunc- 
tions/disjunctions of modal subformulas. In this case, the equivalence between O and 
cp follows from the ones given in Theorem 5.3 together with the rule of substitution of 
equivalences (which is valid in PDL). ■ 

For our running example, hasGun — > [load\[shoot]^alive is a consequence of the 
theory T with the dependence relation '^ because its regression is classically valid. 

Hence, modulo equality, we obtain the same result as for Reiter 's regression in our 
example. This generalizes: a close look at both algorithms shows that if both our T 
with'^ and Reiter 's domain description are obtained from the same Poss(.), causes'^ {.), 
causes~{.), Cond~^{.), Cond~[.), then the results are logically equivalent. 

It follows thus that whenever Poss(.), causes'^{.], causes~{.], Cond~^{.), Cond~{.) are 
given, and the completeness assumptions can be made, then Reiter 's formulation in 
terms of Successor State Axioms and ours in terms of effect axioms and dependence 
do the same job in their respective logical basis: 

Corollary 5.2 

Let the sets Poss{.), causes~^(.), causes~[.), Cond'^[.), Cond~{.) be given. Let P^ = 
(£[)PQL+ , I=^,'7r) be a Reiter theory obtained from them as described in Section 5.3, 
and let V = (£pdL) t^ ,^) be obtained from them as described above. Let (^ be a 
complex formula without quantification and equality. Then V^^ ^ O if and only if 

Proof: 

Straightforward. ■ 

5.5 What about the Ramification Problem? 

Reiter 's solution supposes that domain descriptions only contain executability and 
effect laws. Thus it does not allow for static laws such as walking — > alive. Such laws 
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augment the effects of the shoot action: shooting not only has the (direct) effect ^alive, 
but also the (indirect) effect ^walking (Figure 5.2). 






Figure 5.2: Indirect effect of shooting: the turkey stops walking. 

Because an action can have too many indirect effects, stating all of them in the form 
of effect laws may be unfeasible and make the domain description unmanageable. 
The problem of being able to derive all indirect effects of an action without explicitly 
stating them as axioms is known as the ramification problem [32]. Basically, this one 
states that we should not relate actions with their indirect effects (in the base logic). 

In the example above, instead of stating the law loaded — > [shoot]^walking in the 
theory, we should rather be able to conclude that ramification just from the base ef- 
fect laws for shoot and the static law walking — > alive. Nevertheless, as extensively 
addressed in the literature, static laws alone are not enough to express a notion of 
causation and thus cannot cope to avoid the derivation of indirect effects not prop- 
erly caused by the action under consideration. For example, from [tease]walking and 
walking — > alive in our scenario, we conclude that alive is always true after execution 
of action tease, which intuitively may not be the case if alive initially does not hold: 
teasing a dead turkey does not resurrect it. 

This means that the only indirect effects that follow from an action theory should 
be those that are really relevant. 

In the recent literature on reasoning about actions, the concept of causality has 
been studied as a means of overcoming the inadequacy of static laws in tackling the 
ramification problem. In this sense, many types of causal notions have been pro- 
posed so that causality is then considered in different ways: strong [78, 83, 119, 64] or 
weak [112, 14] causality (if we always/orce or only permit something to be caused); as a 
predicate [78], a relation [112, 14] or a modality [84, 45, 43, 35]; and primitive (built in the 
logic) [78, 43, 119] or derived (with the aid of some meta-logical information) [112, 14]. 



56 Recasting Reiter 's Solution 



The dependence-based solution to the frame problem we have chosen is an ex- 
ample of a meta-logical causal notion expressed as a relation. With it we avoid the 
problem of stating indirect effects in the base logic without unintuitive results. In our 
example, by stating the dependence shoot ^^ -^walking we get shoot's indirect effect, 
and because tease -/> alive, we do not get alive as indirect effect of tease. 

Basically, all the extant approaches in the literature perform well in describing 
dynamic domains where ramifications have to be dealt with. Nevertheless, things 
get more complicated when actions with both indeterminate and indirect effects are 
involved. This is what we are going to address in the following chapter. 



Chapter 6 

where we show what others cannot do 



Causality and 

Indeterminate Indirect Effects 



In the sharp formulation of the law of causality - 'if we know 

the present exactly, we can calculate the future' - it is not the 

conclusion that is wrong, hut the premise. 

— Heisenberg 

In this chapter, we investigate the behavior of the main existing causal approaches 
to reasoning about actions that are called fluent-indexed frameworks. In particular, 
we analyze how they perform in dealing with domains that have actions with both 
nondeterministic and indirect effects. For this, we present an example of such a sce- 
nario, give a requirement concerning the interpretation of indeterminate indirect ef- 
fects and study it through the chapter. 

6.1 The Mailboxes Scenario 

Many approaches consider that it is a change in some property that produces (causes) 
change of some other property. We call \hem fluent-indexed approaches, for they relate 
pairs of literals or formulas. 

We argue here that fluent-indexed approaches are not enough for dealing with the 
ramification problem in domains involving actions with both nondeterministic and 
indirect effects. We do this by showing an example of this class of action domain that 
will lead us through a systematic analysis of such approaches. 

We present here the Mailboxes Scenario, which was originally defined in [15]. 

57 
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In essence, it combines Reiter's famous "dropping a coin on a chessboard" exam- 
ple with Sandewall's argument against causaUty-based solutions to the ramification 
problem [101]. 

In such a scenario, we reason about the status of a particular e-mail message and 
two mailboxes (Figure 6.1). 



f @ \ 





Figure 6.1: The Mailboxes Scenario. 

The domain is as follows: suppose mbox] means "the message is in mailbox 1", 
and mboxl "the message is in mailbox 2". We represent the fact that the e-mail is 
saved in mbox] or in mboxl or in both by the literal saved. Hence the static law for this 
example is 

saved <-> [mbox} V mboxl) 

in formalisms that are not situation-indexed, and 

Holds [saved, s) <-> [Holds[mbox'\ ,s)V Holds[mboxl,s)) 

in situation-indexed formalisms such as the Situation Calculus. (As usual, we assume 
that all free variables denoting situations are universally quantified.) 

Consider the actions save] and savel, whose direct effects are to save an e-mail 
message in mbox] and in mboxl, respectively. Suppose we also have a nondetermin- 
istic save action, whose direct effect is saved, i.e., saving the e-mail in one of the two 
mailboxes or in both. Hence save has the indirect effect mboxl V mboxl. This is also 
an indeterminate effect. Note that, in particular, after executing save, it is also possible 
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to have mbox] A mboxl. This is just as in Reiter's "dropping a coin on a chessboard" 
example, where drop has the possible effect black A white} 

In order to correctly reason about a nondeterministic action, we have to be able 
of properly treating its set of indeterminate effects. This means that we should not 
systematically interpret effects described with the inclusive disjunction 'V as the ex- 
clusive one '©'. For example, in the Mailboxes Scenario, the effect of save should not 
be equivalent to mbox] © mboxl. The motivation for such a requirement has been 
originally suggested by Reiter. 

As we will see along this chapter, the Mailboxes Scenario is problematic for all 
the existing approaches allowing for the representation of actions with both indirect 
and indeterminate effects. In what follows, we discuss the approaches of Lin [78, 79], 
McCain and Turner [83, 84], Thielscher [112, 113] and Zhang and Too [119]. Indeed, it 
can be shown that, in all these frameworks, either we have to state a frame axiom, or 
to relate an action (in the base logic) with some of its ramifications, or, in order not to 
violate our requirement about the interpretation of disjunctions, the action save] has 
the indirect indeterminate effect of changing mboxl, which is clearly counterintuitive. 



6.2 JMinimization of Causality 

We here examine the behavior of Lin's causal approach [78, 79] in formalizing the 
Mailboxes Scenario. 

Roughly speaking, Lin proposes to add a new predicate Caused[.] to the Situation 
Calculus. Caused{p,v,s) reads as "atom p is caused to have truth value v in situa- 
tion s". Such a predicate is used to describe the appropriate causal relationships be- 
tween fluents. In order to solve the frame problem, instances of Caused(.) shall be 
minimized via circumscription [86, 87, 76]. 

In addition, the following axioms are assumed: 

Caused(p, true, s) — > Holds[p, s) (6.1) 

Caused{pjalse,s) — > -^Holds(p,s) (6.2) 



^It is possible as well to rephrase our example in terms of Reiter's: we can regard action save as drop, 
which means putting a pin on a white, a black, or both squares (the pin lying on the region between two 
squares), savel (resp. save!) can be seen as analogous to dropl (resp. drop!), which means putting the pin 
in a black (resp. white) square. 
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which state that something that is caused in a situation s must hold in such a situation, 
as well as something that is caused to cease is no longer valid in that situation. 

In what follows, we describe the Mailboxes Scenario using this formalism. Fol- 
lowing the definitions in the original work, the effect axioms for this scenario are: 

Poss{save] ,s) — > Causedimboxl ,true,do[save'\ ,s)) (6.3) 

Poss{save2,s) — > Caused[mbox2,true,do[save2,s)) (6.4) 

Poss{save,s) — > Caused{saved,true,do[save,s)) (6.5) 

Then, according to Lin's method, we have to supplement the static law saved <-> 
[mbox] V mboxl] in the following way: as save} (resp. savel) has effect mboxl (resp. 
mboxl) and mbox} (resp. mboxl) being true causes the truth of saved, then we must 
causally relate mbox} (resp. mboxl) and saved. This is done stating the formulas: 

Caused{mbox},true,s) — > Caused[saved , true , s] (6.6) 

Caused{mbox2,true,s) — > Caused[saved , true , s) (6.7) 

Thus, the way domain constraints and effect axioms are stated defines a fluent- 
indexed strong causal notion: an atom being causally related with another, whenever 
it becomes true, the other is forced to become true. 

The other way round, as an execution of save has the direct effect saved and a 
change in saved means a change in mbox] and/or in mboxl, we are obliged to causally 
relate saved with both mbox] and mboxl. This is done stating the formula: 

Caused{saved, true, s) — > Caused[mbox] , true,s) V Caused[mboxl, true, s) (6.8) 

Stating just these laws, according to the circumscription-based minimization pro- 
cess defined in [79], we would get an exclusive interpretation of the disjunction 
in (6.8), i.e., save would have the indirect effect mbox] © mboxl. So, in order to capture 
the possibility of save saving the e-mail in both mailboxes, in Lin's approach we have 
also to state the constraints:^ 

Caused(saved, true, s) — > Caused(mbox] , true, s) V Caused(mbox] ,false,s) (6.9) 

Caused[saved, true, s) — > Caused[mboxl, true, s) V Caused{mboxl, false, s) (6.10) 



^It is worth noting that both consequents of (6.9) and (6.10) are not tautologies (cf. [78]). 
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Thus, we have the following: 

Proposition 6.1 

Formulas (6.3)-(6.10) entail 

Possisavel , s) — > Caused(mbox2, true, do{save] , s) )V 
Caused(mbox2, false , do{save] , s) ) 

Proof: 

Suppose that Poss[save] ,s) is the case. Then, from Formula (6.3) we obtain 
Caused[mbox] , true,s'), where s' stands for do[save\ , s). From this and Formula (6.6), 
we get Caused{saved, true, s'). Thus, constraint (6.9) gives us Caused{mbox] , true,s') V 
Causedimbox] , false, s']. Nevertheless, even with the minimization policy defined 
in [79], it is still possible to derive another extension: from Caused(saved , true,s') and 
constraint (6.10) we conclude Caused(mbox2, true, s') V Caused{mbox2, false, s'). ■ 

So, we get that an execution of save! can produce the indirect effect of changing 
mbox2. But we do not want such an indirect effect, for save} would be nondeterminis- 
tic. A possible solution for this could be to state 

[Poss[save} ,s) A^Holds{mbox2, s)) — > Caused[mbox2, false, do[save] ,s)) 

from which we derive 

{P OSS [save] ,s) A^Holds[mbox2, s)] — > -^Holds{mbox2,do{save'\ , s)] 

but this is a frame axiom. 

Another tentative of tackling the problem is stating 

Poss[save] ,s) — > Caused{mbox2,false,do{save] ,s)] 

but, this is unintuitive, for in a situation where we already had saved, with the e-mail 
in mbox2, saving again with save! would make a change in mbox2. 

6.3 Causal Laws Approach 

In this section, we formalize the Mailboxes Scenario using the base formalism pro- 
posed by McCain and Turner [83]. Their approach considers that background knowl- 
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edge about causation should be given in the form of causal laws, which are stated as 
sentences in a modal, conditional logic with the aid of a causal modal operator =^ . 

A causal law of the form cp ^ i|), where cp and \j) are classical formulas, is read as 
"(p causes i|)", or "the truth of cp determines the truth of \|)". In our terms, this is thus 
a fluent-indexed causal approach. 

Let Laws be the set of all causal laws concerning a given domain. A set of formu- 
las T is closed under Laws if and only if whenever cp ^ ij) is in Law^s and cp € T, 
then -^ G T. T h cp means that formula cp belongs to the smallest set of formulas 
containing T that is closed w.r.t. propositional logic and also closed under Law^s. 

In the formalization that follows, a set of literals Facts denotes a knowledge base 
(alias state), and Eff a set of direct effects. 

With the causal laws approach, the representation of the Mailboxes Scenario is as 
follows: 

{saved => [niboxl Vniboxl), \ 
(mbox) V mboxl) => saved J 

The causal law saved =^ [mbox] V mboxl) is needed because the truth of fluent saved 
causes the truth of formula mbox] V mboxl. Analogously, (mbox] V mboxl) =^ saved is 
necessary because mbox] V mboxl being true causes saved also to be true. (Instead of 
[mbox] V mboxl) => saved one could have as well the causal laws mbox] => saved and 
mboxl =^ saved, whose justifications are straightforward. On the other hand, we could 
not replace saved => [mbox] V mboxl) by saved => mbox] and saved => mboxl, for in this 
case save would always cause mbox] A mboxl.) 

Completing the domain description, we have a set of initial observations: 

Factso = [-^mbox] ,^mboxl,^saved} 

and we suppose that saved has been produced as a direct effect: 

Eff = {saved} 

From this representation and according to McCain and Turner's approach defined 
in [83], after save action we get an exclusive interpretation of the disjunction mbox] V 
mboxl. This is shown in the following proposition: 



§6.3 Causal Laws Approach 63 



Proposition 6.2 

Let Factso = {-^mboxl ,^mbox2,^saved} and Eff = {saved}. Then the only possible 

successor states are: 

{{mboxl , -^mbox2, saved], 1 
{-^mbox} , mbox2, saved] J 

Proof: 

Following the definitions in [83], for any knowledge base Facts, any direct effects Eff, 
and any set Laws of causal laws, the set of possible next states after performing an 
action is the set of interpretations Facts' such that: 

Facts' = {£ : £ G £it, (Facts n Facts') U Eff 1^^^^ Q 

where b- is derivabilitv w.r.t. the causal laws defined in Laws. 

Laws -' 

For the possible next state Factsi = {mbox] ,^mbox2, saved], we have Factso n 
Facts 1 = {-^mbox2] and {-^mbox2] U {saved] 1^^^^ mbox], and this is a possible next state. 
For the state FactS2 = {-^mbox] , mbox2, saved], we have Factso n FactS2 = {-^nibox] ] and 
{-'raboxl} U {saved] ^^^^ nibox2, and this is a possible next state, too. The interpreta- 
tion Factsa = {-^mbox\ ,^mbox2, saved] is not a possible next state as clearly Factss is 
not closed under Laws. Now, considering the state Facts4 = {mbox] , mbox2, saved], we 
have Factso n FactS4 = and neither U {saved] 1^^^^ mbox] nor U {saved] Ij^^^^ mbox2, 
so FactS4 is not closed under Laws. Thus, the only possible states after performing the 
save action are Facts i and FactS2, and from this the result follows.'^ ■ 

In order to avoid exclusive interpretation of disjunctions, we have to relax inertia 
by increasing Laws with the following causal laws 

[saved A mbox] ) => mbox] 
[saved Ambox2) => mbox2 

However, with this apparent solution we get that an execution of savel could make 
a change in mboxl: the interpretation {mbox] ,mbox2, saved] is a possible next state of 
Factso w.r.t. Eff = {mbox]]. 

In [84] an improved version of the causal laws approach is given. Basically, the 
difference is that actions are made explicit and each action, fluent and formula has an 
associated time point. For example, save] j means that the action of saving the e-mail 



■^The reader is invited to verify that with the causal laws mbox] =^ saved and mboxl =7- saved instead 
of [mbox] V mboxl) =^ saved one obtains the same result. 
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in mailbox 1 is executed at time point 2, and having mbox] 3 means that at time point 3, 
the e-mail is saved in mailbox 1 (independently of the action that has been executed 
to achieve that). 

Besides considering time, the following standard schemas are also assumed (remem- 
bering, a stands for action names, p for atom (fluent) names, and cp for a formula): 



flt ^ fit 



(6.11) 



^Po ^ ^Po 
(ptA(pt+i ^ cpt+i 



(6.12) 
(6.13) 
(6.14) 
(6.15) 



Schema (6.11) (resp. (6.12)) states that the occurrence (resp. non-occurrence) of 
action a at time t is caused whenever a occurs (resp. does not occur) at t. The 
Schemas (6.13) and (6.14) establish that the initial observations are caused from the 
beginning. Schema (6.15) formalizes the common sense law of inertia, representing 
the fact that whenever a set of fluents holds at two successive time points, their truth 
at the second time point is taken to be caused simply by virtue of its persistence. 



Using this variant of the causal laws approach, we formalize the Mailboxes Sce- 
nario in the following way (Laws, Factso and Eff are as above, except that they are 
time-indexed): 

save] t A -^mboxl t =^ mbox] t+i , 

savelt A -^mboxlt =^ mbox2t+] , 

Laws = i savet =^ savedt+] , } 

savedt =^ [mbox] t V mboxlt) , 

[mbox] t V mboxlt) =^ savedt 



Factso = {-^mbox] 0, ^mboxlo, ^savedo] 



Again, with such a representation, our requirement about the interpretation of the 
disjunction is violated: we get an exclusive interpretation of the nondeterminism of 
the save action. As before, if we relax inertia by means of some extra causal laws, we 
will also get that save] may cause a change in mboxl. 
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6.4 Postprocessing Approach 

In this section, we examine the postprocessing generation of ramifications proposed 
by Thielscher [112, 113]. The basic idea of this approach consists in admitting states 
not satisfying the domain constraints, which are seen as "intermediate states". "Sta- 
ble" states are obtained after successive applications of the so called causal relations. 
A causal relation £i causes £2 if ^/ where ^1 , £2 £ -^it and cp G g^ml, is the way a fluent 
indexed causal notion is defined in this approach. 

In what follows, an action law is a triple {C,a, E), where a is an action, and C and 
E are sets of literals containing, respectively, the action preconditions and effects, and 
such that atm(C) = flfm(E) (C and E have the same atoms). An influence relation is 
a relation between atoms that is used to automatically generate the causal relations. 
Saying that a pair {p^,p2), where P'^,P2 £ ^'^op/ is in the influence relation means that 
a change in the truth value of p^ may cause a change in the truth value of pj- 

A state of the world (not necessarily satisfying the domain constraints) is a pair 
of sets of literals (Facts, Eff ), where Facts denotes a knowledge base and Eff a set of 
direct effects. An action law (C,fl,E) is applicable to a state (Facts, Eff) if and only 
if C C Facts. Performing an action a in a state of affairs Facts corresponds to ap- 
plying its associated action law (C,fl, E) to the pair (Facts, Eff), giving us a new pair 
(Facts', Eff'), where Facts' = (Facts \ C) U E and Eff' = Eff U E. 

A causal relation £1 causes £2 if <P is applicable to a state (Facts, Eff) if and only if 
Facts |=gp|_ cp A -'£2 A £1 and £1 G Eff. The state resulting from applying such a causal 
relation is (Facts', Eff), where Facts' = (Facts\{-£2})U{£2}andEff' = (Eft\{^l>2]Mh]- 

For the Mailboxes Scenario, we define the following action laws: 

{{-^mbox]},save'\ ,{mbox'\}) (6.16) 

{{-^mbox2},save2,{mbox2}) (6.17) 

{{-^saved}, save, {saved}) (6.18) 

Action law (6.16) expresses that "in a state where mbox] is false, after executing 
save] , mbox] will be true". For action laws (6.17) and (6.18), the reading is analogous. 

The set of static laws is the singleton {saved <-> [mbox] V mboxl)}. 

According to Thielscher 's approach, as for this example a change in mbox] (resp. 
mboxl) may cause a change in saved and vice-versa, we have to define the influence 
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relation for this scenario as follows: 



{{mbox}, saved), {mbox2, saved), 1 
(saved, mbox]), (saved, mboxl) J 

From this influence information and Algorithm 1 given in [112], we obtain the 
following set of causal relations: 



saved causes mbox] if ^mboxl, 

saved causes mboxl if ^mbox\ , 

-^mbox] causes ^saved \i ^mboxl, 

-^mboxl causes ^saved if -^mbox] , 

mbox] causes Sflyed if T, 

-^saved causes ^mbox] if T, 

mboxl causes saved if T, 
-^saved causes ^mboxl if T 



Thus, with this domain description, we get the following: 

Proposition 6.3 

Let ({-^mbox] ,^mboxl,^saved},^) he an initial state. Then the only possible succes- 
sor states after executing save action are ({mbox] ,^mboxl, saved], {saved, mbox]}) and 
({-^mbox] , mboxl, saved}, {saved, mboxl}). 

Proof: 

Let ({-^mbox] ,^mboxl,^saved},$) be the initial state. Then, applying the action 
law (6.18) to it, we get the resulting (intermediate) state 



({-^mbox] , -^mboxl, saved], {saved}) 



(6.19) 



As (6.19) is inconsistent w.r.t. the static law saved <-> (mbox] V mboxl), we apply the 
causal relation saved causes mbox] if ^mboxl to (6.19) and obtain 

({mbox] , -^mboxl, saved], {saved, mbox]]) 



which is a successor state [112]. In this state, no other causal relation can be applied. 

Looking at (6.19) again, we apply the causal relation saved causes mboxl if -^mbox], 
and obtain 

([-^mbox] , mboxl, saved], {saved, mboxl]) 
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which is a successor state, too. Again, in such a state, no other causal relation is 
applicable. The same observation holds now for (6.19). 

Therefore, there are only two successor states. ■ 

Then, we get that with Thielscher's approach, action save gives an exclusive inter- 
pretation of the conjunction in its indirect effects. 

6.5 Modal Causality 

We now formalize the Mailboxes Scenario using the base logic EPDL, proposed by Foo 
and Zhang [119, 35]. Essentially, such a logic is an extension of PDL that allows for 
modalities of the form [cp], with cp E g'm[, for specifying the indirect effects of actions. 
Given (p,i|) e 5^m[, the causal statement [(p]ij) means that formula i|) is caused when- 
ever cp is the case. The semantical counterpart of such an extension is that models are 
of the form (W, R), where W is as defined in Chapter 2, and K : 2lct U dml — > 2^^^ is 
a function mapping action constants a to accessibility relations ]?« C W x W, and clas- 
sical formulas cp to accessibility relations K^p C W x W. Moreover, every EPDL-model 
^ = ( W, R) must satisfy that for all w E W and every cp G 5^ml, if ^ cp, then wR^pW. 

Therefore in EPDL we are able to write formulas like [mboxl]saved, which states 
that in all possible worlds in which mbox] is true, saved is caused to be true. The 
complete domain description for the Mailboxes Scenario in EPDL is given bellow: 

[saved] [mboxl V mboxl) , [mboxl V mbox2]saved , 
'^ = { {save)T, {save'\)T, {save2)T, 

[ [save]saved,[save]]mboxl,[save2]mbox2 J 

In Foo and Zhang's approach, static laws are implicitly derived from the causal 
statements. Then, for the theory above, we have T hepp,, saved <-> [mbox] V mbox2) 
without explicitly stating it. 

Proposition 6.4 

T l=gp|3|_ i^mbox] A^mboxl) — > [save^][mbox^ Vmboxl). 

Proof: 

1. ^mbox] — > [sflyel]mfcoxl, from global axioms T and classical logic 

2. -^mbox2 — > [savel]mbox] , from global axioms T and classical logic 

3. [mbox] V mbox2]saved, from global axioms T 
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4. [mbox] V mhoxl) — > saved, from 3. and EPDL 

5. -^mboxl — > [save]]saved, from 2., 4. and classical logic 

6. [saved] [mbox] V mhoxl), from global axioms T 

7. sflyed — > [mbox] V mhoxl], from 6. and EPDL 

8. ^mhoxl — > [save]]{mbox] V mhoxl], from 5. and 7. 

9. i^mbox] A^mboxl) — > [save]]{mhox] A [mbox] V mhoxl]), from 1. and 8. 
10. [^mhox] A^mhoxl) — > [save]]{mhox] Vmbox2), from 9. and classical logic 



This happens because no specific solution to the frame problem is associated to 
EPDL, and then, without considering the frame axiom -^mboxl — > [save]]^mboxl, we 
still get the above unintuitive result. As a way of avoiding to state frame axioms in the 
domain description, Foo and Zhang [120] suggest to generate them "on the fly", i.e., 
by the time queries are made. This could be achieved based on an interpolation result 
stating that the only frame axioms needed are those mentioning actions and atoms 
occurring in the vocabulary of the query. With this, according to the authors, it would 
be enough to use some method for automatically generating frame axioms from the 
effect laws, like, e.g. Pednault's [95]. 

The advantage of such an approach to the frame problem is the fact that no infor- 
mation about persistence has to be stated in the action theory. The inconvenience is 
that frame axioms are still needed and must be computed during the reasoning pro- 
cess. This constitutes an overhead that is neatly worse than that produced by checking 
the literal preservation condition of the dependence-based approach (cf. Section 4.4). 

6.6 The JMailboxes Scenario with Dependences 

So far we have seen the difficulties that arise when we try to formalize actions with 
both indeterminate and indirect effects in fluent-indexed causal approaches. 

The problem with all these formalisms is that in our scenario there is an atom 
(saved) that can be caused in two different ways (directly with save or indirectly with 
save] or savel) and that can or cannot cause nondeterministic ramifications depending 
on the way it was generated. With fluent-indexed approaches we cannot record this 
subtlety and this is the main reason they all fail in formalizing this example. So, with 
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all this discussion, we have seen that with the approaches presented in [78, 79, 83, 84, 
112, 119, 35] either we get an exclusive interpretation of the nondeterminism, or we 
have to state frame axioms in the action theory. 

Here we present the formalization of the Mailboxes Scenario in the dependence- 
based approach, which is action-indexed. The corresponding action theory for that is 
^m«i/ = ('CpDL,b''^)' where 



r = < 



saved <-> [mbox] V mboxl), 

[save]saved, [save]]mbox] , [save2]mbox2, 

{save)T, {save])T, {save2)T 



{save] ymboxl), {savel, mboxl), 
{ {save] , saved), {save!, saved), 

I {save , saved) , {save , mbox 1 ) , {save , mboxl) 

Then, we have ^I^^^,-; 1= [save](mbox] V mboxl), as intended. 

This supports our thesis and others' [102, 101, 14] according to which causality 
must be action indexed, and also justifies our choice for the dependence-based solu- 
tion to the frame problem. It is important to observe, however, that with it we do 
not entirely solve the ramification problem: while indirect effects such as [save]]saved 
can be deduced with |= without explicitly stating that in the set of laws for savel, we 
nevertheless still have to state indirect dependences such as save] ^^ saved. However, 
according to Reiter's view: 

"what counts as a solution to the frame problem ... is a systematic proce- 
dure for generating, from the effect laws, ... a parsimonious representa- 
tion for [all] the frame axioms" [100]. 

The framework of ^^ complies with that as the dependence relation can be semi- 
automatically generated from the set of static and effect laws [13]. Moreover, as it has 
been shown in this chapter and argued in [15, 55], our approach is in line with the 
state of the art because none of the existing solutions to the frame and the ramification 
problems can handle domains with both indeterminate and indirect effects. 
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Chapter 7 

where we open our toolbox 



Refining Modularity and 
Computing Implicit Laws 



So act that your principle of action might 
safely he made a law for the whole world. 

— Immanuel Kant 



In this chapter, we make a step further into the concept of modularity. Besides 
considering a solution to the frame and ramification problems integrated in the base 
formalism, we develop a more fine grained analysis of modular theories. We achieve 
that by investigating some possible arrangements of modules and establishing a set 
of postulates that characterize modularity. Moreover, we also define algorithms to 
identify the troubled part of a given theory. 

7.1 Defining Modules 

Remembering our central hypothesis, what we argue for is that the different types 
of laws defined in Section 2.2 should be neatly separated in modules. Besides that, 
following the ideas in Chapter 4, we want such laws to interfere only in one sense: 
static laws together with action laws for a may have consequences that do not follow 
from the action laws for a alone (e.g. ramifications). The other way round, action laws 
should not allow to infer new static laws, action laws for a should not allow to infer 
action laws for a' , etc. This means that our logical modules should be designed in 
such a way that they are as specialized and as little dependent on others as possible. 

71 
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Our first claim is that the distinction made between the types of laws commonly 
used in reasoning about actions is not just a matter of syntactical sugar. By identifying 
such a distinction and treating different formulas in different ways, we tacitly assume 
that they constitute the basic entities in the theory of a domain description. It is not 
difficult to see why: to determine the set of possible states, static laws must be dealt 
with in a careful manner; in plan generation tasks, executabilities play an important 
role; for prediction and regression, the effect laws take their turn; etc. 

To simplify the presentation, in this chapter we investigate how this can be accom- 
plished when just one action is considered. A generalization of the results we obtain 
here is addressed in Chapter 8. 

Given that, our first proposal here is to separate laws of different types into dif- 
ferent pieces of a theory. Henceforth, the set of all static laws of a domain will be 
denoted by 5 C g^ml. For a e 2lct, the set of effect laws for a is denoted by £"; the set 
of all executability laws for a will be denoted by X"; and all inexecutability laws for a 
is denoted by I". 

Definition 7.1 (Action theory for a) 

An action theory for a is a tuple V = (£pdl , h^ , T), where T = S U S" U X" Ul". 

In our running scenario example, an action theory for tease would comprise 

iS = {walking — > alive}, E^'^"^ = {[tease]walking}, 

p^iease ^ ^i^i^ase)-J\ I^'"'' = {^alive -^ [tease] ±], 
and a dependence '^= {{tease, walking)}. 

With these basic entities, we address now modularization of action theories. In 
what follows, given an action theory V, we propose and analyze some possible ar- 
rangements of the sets S, £", X" and T" into what we call module prototypes (cf. 
Section 3.1). The purpose here is to argue backwards from analyzing what modules in 
reasoning about actions should be to a definition of modularity that better fits it. As 
we cannot cope with local completeness (cf. Section 3.3), what we do in the sequel is 
to relax such a principle and allow modules to have some degree of interaction. This 
will give us a "coupling-friendly" modularity [57]. 

Looking at the set S alone, we see that static laws do not mention actions at all, 
and then, in our context, they do not contain modal operators. This means that for in- 
ferences concerning only static laws, we need neither all expressiveness of PDL nor its 
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consequence relation. This suggests that static laws should constitute a module pro- 
totype in classical propositional logic. Let (£cpli Itpi '"^^ ^^ such a sub-description, 
where jCqpl is the language of the classical propositional logic, and \=^p^ is the classical 
entailment relation. 

Regarding the solution to the frame and ramification problems, it could be rea- 
sonable to define a module prototype only for frame axioms. This would give us 
(-CpoL) i^)0)- Nevertheless, a solution to the frame problem is global to the theory, 
in the sense that its solution is necessary to most reasoning tasks. Moreover, deduc- 
tion of frame axioms is mainly important in interacting with effect laws, and not for 
just deriving some frame axioms sporadically. Because of this we consider having a 
module like that would not really help modularity. 

With a similar reasoning, we can expect to have a module prototype built on the 
effect laws £" and |= : (£pdl > hpr,, > £'')f i-e., a sub-description for deriving effect laws. 
Unfortunately, in the presence of the frame and ramification problems, this is not 
enough: in all inferences about effect laws, information about frame axioms and in- 
direct effects (ruled by a causal notion) must be taken into account. This means that 
(-CpDL ) hpDL > ^") would not be good as a module for reasoning about actions. 

By applying the same analysis as in the above paragraphs, we can see that 
(-CpoL) l^pni '"^"^ ^^'^ (-CrdL) Hnit^") ^^^ '^ot good as modules either. Even if, a pri- 
ori, we do not need frame axioms to infer executabilities, the absence of static laws is 
too restrictive. For the case of inexecutabilities, as long as they can be seen as a special 
type of effect laws, frame axioms are important, or, as we are going to see in the se- 
quel, because of some overlaps between £" and I", we should at least guarantee that 
all inexecutabilities entailed by the theory are in I" (and thus S is mandatory). 

Because static laws describe the laws of the universe being represented (and that 
must be respected in every reasoning), it is reasonable to consider them as part of 
every module.^ One of the reasons for that is the situation illustrated above: with- 
out S, it is not possible to derive indirect effects with (£pdL) l^pni'^")' ^^^ same can 
be said about the solution to the frame problem: it should be present at least when ef- 
fects are under concern. Moreover, there are trivial effect laws that are entailed by I": 
cp — > [fl]_L entails (p — > [fl]i|; for any ^\) £ g^mL^ In this case, we may also need inex- 



^We could also see them as global data with a special status, similarly as done in [64]. For the sake 
of presentation, we prefer to keep static laws in the same level as action laws, i.e., seeing them just as 
formulas of a theory, so that the difference is just what they are for. Of course, in real implementations 
there should be no redundant replications of the set S . 

^If we were to argue against the principle of explosion (cf. Section 3.3), this could be a reason. 



74 Refining Modularity and Computing Implicit Laws 



ecutabilities to guarantee the module's completeness. So a module prototype better 
than {CpDL, ^pDL ' ^"^ would rather be (£pdl, b^ , <S U £:" U I"). With it, all effects, non- 
effects and ramifications of actions should be derived. 

As long as action laws other than elements of X" are not necessarily needed to 
infer executabilities, we can expect (/^pdL) hpr,, i^ U X") to be a module prototype 
for deriving executability laws. Similarly, and despite the fact that £" plays a role in 
the deduction of inexecutabilities, we shall define (£pdl, l=pnL ''^ ^ '^"^ ^^ ^ module 
prototype for inexecutability laws. 

So, now we have four module prototypes: one for inferring in classical logic, 
(-^CPL, l=gpL''^^' °^^ ^°^ doing prediction and explanation in PDL with a solution to 
the frame and ramification problems, (£pDL) [^ , 5 U (5" U J"); a module prototype for 
inferring executability laws (£pdL) hpQL > S U <%""); and one for the deduction of inexe- 
cutabilities, (£pDL) l=pnL ''^ ^ '^''^' ^^^^ sub-descriptions are minimal in the sense that 
each one contains the minimum necessary potential interaction inside their data to the 
realization of inferences in its domain of application. For instance, as argued above, 
weakening (£pdl> t^ , 5 U <5'' U J") may have as consequence that some laws will no 
longer be inferable in the module. 

With that, we define our version of local completeness that gives us modularity: 

Definition 7.2 (a-modularity) 

LetV = (£pDL, h^ , T) be an action theory for a such thatT = S US" U X" Ul". V is 
fl -modular if and only if 

1 P" h (p implies (£cPL, ^pl-'^) h <P 

2. P" h (p ^ (fl)T implies (£pdl, ^^^,S U X") ^ <p ^ {a)T 

3. V^ ip^ [fl]± implies (£pdl, [j,^^,S uT) ^ <p ^ [fl]± 

4. P" h (p ^ [a]^ implies (£pdl, ht, . '5 U <?" U X") h (p ^ [a]^\> 

The main difference between our definition of local completeness and those of 
Garson and Cuenca Grau et al. (cf. Section 3.3) is that we do not require modules to 
be disjoint modulo logical consequences. In other words, we allow for a formula of a 
given type to be inferred from different modules. 

Just having module prototypes defined in our way is not enough to have a- 
modularity. This is what we address in the sequel. 



§7.2 More Fine Grained Postulates 75 

7.2 More Fine Grained Postulates 

A first step toward modularity has been the proposed division of our entities into 
modules. Recalling the discussion in Chapter 3, in order to accomplish our goal, we 
have to diminish interaction among such modules, rendering them the least interwo- 
ven we can. 

Restricted to the case of one action, in the rest of this chapter we will state and 
investigate postulates that guarantee modularity, and give a method to satisfy them. 
Although we here use the syntax of PDL, all we shall say applies as well to first-order 
formalisms, in particular to the Situation Calculus. All postulates we are going to 
present can be stated as well for other frameworks, in particular for action languages 
such as A, ATI [39, 65, 44] and others, and for Situation Calculus based approaches. 
In [57] we have given a Situation Calculus version of our analysis. 

Let V" = (£pDL, b.,T) be such that T = S U£" U X" Ul". 

PC (Logical consistency): D" ^ ± 

The theory of a given action should be logically consistent. 

PS (No implicit static laws): if P" \= cp, then (£cpl, ^rl-'^) ^ ^ 

If a classical formula can be inferred from the action theory, then it should be inferable 
from the set of static laws alone. 

PI (No implicit inexecutability laws): 

if P" h cp ^ [fl]±, then (£pDL,^DL"^U2:'') h <P ^ M^ 

If an inexecutability law for a given action a can be inferred from its domain descrip- 
tion, then it should be inferable in PDL from the static laws and the set of inexecutabil- 
ity laws for a alone. 

PX (No implicit executability laws): 

if iy^^^{a)T, then {£pDL,[f^^,S U X") ^ <p ^ {a)T 

If an executability law for a can be inferred from its action theory, then it should al- 
ready "be" in X", in the sense that it should also be inferable in PDL from the set of 
static and executability laws for a alone. 
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Postulate PC is obvious, for we are interested in consistent theories. Moreover, it 
can be shown that PX is a consequence of PS (see Corollary 8.2). 

Thus, while PC is obvious and PX can be ensured by PS, things are less obvious 
for Postulates PS and PI: it turns out that, for all approaches in the literature, they 
are easily violated by action theories that allow to express the four kinds of laws. 
We therefore study each of these postulates in the subsequent sections by means of 
examples, give algorithms to decide whether they are satisfied, and discuss about 
what to do in the case the answer is "no". 



7.3 No Implicit Static Laws 

While executability laws increase expressive power, they might conflict with inexe- 
cutability laws. Consider, for example, V^^^^' = (£pdl, ht..'^ U S^'"'' U X""'' U I^'"""), 
where 

S = {walking — > alive}, E^^"^^ = {[tease]walking}, 

-please ^ |^fgase)T}, X^'"'' = {^uUve -^ [tease]^} 

and the dependence relation is given by ^^= {{tease, walking)}. 

From this description, we have the unintuitive inference ^f^^^e jfeose i alive: the 
turkey is immortal (Figure 7.1)! This is an implicit static law (cf. Section 4.3) because 
alive does not follow from S alone: P^fl'' violates Postulate PS. 









Figure 7.1: A '^-model for the theory in V ''■. the turkey is immortal. 

Implicit static laws are not a drawback of our underlying logical formalism. They 
also appear in Situation Calculus-based approaches and in causal laws theories. To 
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witness^, suppose in Lin's framework we have 

Ho/ds (p p s ) — > Caused (p2,true,s) (7.1) 

and 

Caused{p2,false,s] (7.2) 

Then from (7.2) and Axiom (6.2), we get 

-^Holds{p2,s) (7.3) 

From (7.2) and the contrapositive of Axiom (6.1) it follows 

-^Caused{p2,true,s) (7.4) 

Finally, from (7.1) and (7.4) we get 

-^Holds{p^,s) 

which is an implicit static law. 

To see how implicit static laws show up in McCain and Turner's causal laws ap- 
proach (cf. Section 6.3), let Law^s contain the causal law cp ^ i|) and T = {^i|)}. Then 
^(p is an implicit static law in such a description. 

How can we find out whether an action theory for a satisfies Postulate PS? Before 
that, we need a definition. 

Definition 7.3 (Big model) 

Letir = (£pDL,h^,T)besuchthatr = <SUf''u;t"'UX''. Then-yg = (W,K) is thebig 
(alias maximal/ standard) model forV" if and only if: 

• J^ isa ^-^ -model; 

• W = valuations[S] (all valuations ofS); and 

• Ra = {[yv,w'] : for all cp ^ [a]y\> G E^yjl", if \^(p, then \^M. 

For an example, consider an action theory whose components are given by 

5 = 0, f" = [p^ ^ M-p^}, X' = {(fl)T}, 



^The examples are from [104]. 
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1" = {P2^ [«]-L}, and ^= [{a ,^p ^) , {a ,^p 2)^ 
Figure 7.2 depicts one of its models and its associated big model. 



(pi.^Pi) 



(^P^Ji) 



(^^J^ 



^''^- (v.v? 



Q^Ef^) 



(^v^^ 



Figure 7.2: A model of V and the big model ./#big of V 



Big models contain all valuations consistent with S. Clearly, for a big model ^ 
we have |= S AE" AT"^. Because ^ extends the set of possible worlds, it is only X'^ 
which might not be true in ^ . 

Theorem 7.1 

LetV" = {CpoL,h^,'T) be such that T = S U £" U X" Ul". V satisfies Postulate PS if 
and only if the big model for P" is a model ofV. 

Proof: 

Let^ = (W,_R) be the big model of 2?" = {CpoL^k. S \J 8" [J X" \J T) . 

(^): As ^ is a big model of V, we have ^ S A £" A I". It remains to show that 
1= X'^. Let (pi — > (fl)T e X", and let w G W be such that |= cpt. Therefore, for 
all cpi € g^mt such that S,£'',X'',I'^ |= <Pi — > H-L/ we must have t^ cpi, because 
S^S^.X",!" [^ -((pi A (pi), and as P" satisfies Postulate PS, S \=p^ -(cpi A cpj), and 
hence |= -■(cpi A cpj). Then, by the construction of ^ , there is some w' € W such that 
1= ,i|), for all cp — > [fl]i|) such that S,£'',I" |= <P — > WiJ^ and |= cp, and wRaw'. Hence, 
1= <Pi — > (fl)T, and thus ^ is a model of V. 

(<=): Suppose P" does not satisfy Postulate PS. Then there must be cp G 5^m[ such that 
P« h cp and {CcPL,^p^,S) ^ cp, i.e., 5,£:^^^J'' h^ cp and 5 ^p^ cp. Hence there 
is a valuation val of S that falsifies cp. As val € W (because ^ contains all possible 
valuations of S), Ji is not a model of P". ■ 
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In the rest of this section, we will characterize when a domain description admits 
a big model. 

We shall give an algorithm to find a finite characterization of all^ implicit static 
laws of a given action theory P". The idea follows that of Algorithm 4.1 with the 
improvement of taking into account dependence information: for each executability 
law (p — > (fl)T in the theory, construct from S'^, I" and '^ a set of inexecutabilities 
{cpi — > [fl]_L, . . . , (pri — > [fl]-L} that potentially conflict with cp — > {a)T. For each I, 
1 < I < n, if cp A (pi is satisfiable w.r.t. S, mark ^(cp A cpt) as an implicit static law. In 
the same way as done in Algorithm 4.2, incrementally repeat this procedure (adding 
all the implicit -'(cp A cpt) to S) until no more implicit static law is obtained. 

For an example of the execution of the algorithm, consider the action theory for 
tease above. For the action tease, we have the executability (tease) T. Now, from g^'^'^^'^^ 
jtease ^^^^ ^^^ ^g ^j.y ^^ build an inexecutability for tease. We take [tease]walking and 
compute then all indirect effects of tease w.r.t. S. From walking — > alive, we get that 
alive is an indirect effect of tease, giving us [tease]alive . But {tease , alive) ^ ^^, which 
means the frame axiom ^alive — > [tease]^alive holds. Together with [tease]alive, this 
gives us the inexecutability ^alive — > [tease]-L. As 5 U {T,^alive} is satisfiable (T is 
the antecedent of the executability {tease)T), we get ^alive — > _L, i.e., the implicit static 
law alive. For this example, no other inexecutability for tease can be derived, so the 
computation stops. 

Before presenting the pseudo-code of the algorithm, we need some definitions. 

Definition 7.4 (Implicate) 

Let cp G ^ml and x be a clause, x is an implicate of cp if and only if (p l^p^ X- 

In our running example, walking V alive and -^walking V alive are implicates of the 
set of formulas {walking — > alive, walking}. 

Definition 7.5 (Prime implicate) 

Let cp G g^mt and xbe a clause, x is a prime implicate of cp if and only if 

• X is an implicate of cp, and 

• for every implicate x' of(p,x' \=^p^_ xi^pH^sx \=^p^_ x' ■ 
The set of all prime implicates of a formula cp is denoted PI( cp ) . 



''Actually, what the algorithm does is to find an interpolant of all implicit static laws of the theory. 
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For example, the set of prime implicates of p^ isjust{p J, and that of p^ A(-'p^ Vp2)A 
i^p^ Vp^Vp^) is {Pi ,P2'P3 ^P4J^- ^^ °^^ shooting domain, alive is a prime implicate of 
{walking — > alive, walking}. For more on prime implicates and their properties, see [82]. 

Definition 7.6 (Function NewCons[.)) 

Let(p,i|) G S'tnl. rhenNez<;Cons(i|;,(p) =PI((p Ail)) \ PI( cp). 

The function Nea;Cons(\|), cp) computes the nezf consequences of i|) w.r.t. cp: the set of 
strongest clauses that follow from cp Ai|), but do not follow from cp alone (cf. e.g. [61]). 
It is computed by subtracting the prime implicates of cp from those of cp A \|). For 
example, NewCons{[^p-^ V P2) ^ i^P^ V P3 V P4),Pi) = [Pz^Pi V P4}. And for our 
scenario, NewCons[walking, walking — > a/roe) = {alive, walking]. 

The algorithm below improves both Algorithms 4.1 and 4.2 by integrating a so- 
lution to the frame problem (via the dependence relation ^^). For convenience, we 
define C = E" \J X" as the set of all formulas expressing the direct consequences of an 
action a, whether they are consistent or not. 

Algorithm 7.1 Finding all implicit static laws induced by a 

input: 2)" = (£pDL,bt..'5U^''UA"'UX'') 

output: Simp*, the set of all implicit static laws of V^ 

C : = £:" U X" 
repeat 

'^imp • ~ V 

for all (p^ (fl)T G ^"do 

for all & C C such that (> ^ do 

il)^„ := Al^'i : Vi -^ [a]A>i G ^"1 
for all X £ Nezf^Consli^^aiiS) do 

if <S U Simp* U {cp, (p^„ , -x) ^p|_ -L and V^i G x, « 9^ ^i then 
<5,-mp : = Simp U {^ ( cp A cp^„ A -x)} 
Oimp* • ~ <Jimp* U '^imp 
until Simp = 

In each step of the algorithm, S U Simp* is the updated set of static laws (the original 
ones fed with the implicit laws caught up to that point). At the end. Simp* collects all 
the implicit static laws. 

The following result establishes decidability of the method: 

Theorem 7.2 (Decidability) 

Algorithm 7.1 terminates. 
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Proof: 

Let C" = £" U J". First, the set of candidates to be an implicit static law that might be 
due to a and that are examined in the repeat-loop is 

{-((p A(p^„ A-x) : ^'' <^C\(p ^ {a)T £ X" and x^NewCons{^\)^,S )} 

As £", 1" and X" are finite, this set is finite. 

In each step, either the algorithm stops because Simp = 0/ or at least one of the 
candidates is put into Sjmp in the outermost for-loop. (This one terminates, because 
X", C and NewCons{.] are finite.) Such a candidate is not going to be put into Sjmp 
in future steps, because once added to 5 U Sjmp*, it will be in the set of laws S U Sjmp* 
of all subsequent executions of the outermost for-loop, falsifying its respective if-test 
for such a candidate. Hence the repeat-loop is bounded by the number of candidates, 
and therefore Algorithm 7.1 terminates. ■ 

While terminating, our algorithm comes with considerable computational costs: 
first, the number of formulas (P(^„ and i|)^„ is exponential in the size of C, and second, 
the computation of NewCons{'\\)(fa,S) might result in exponential growth. While we 
might expect C" to be reasonably small in practice (because £" and X" are in general 
small), the size of NewCons['[\>fja , 5) is more difficult to control. 



Example 7.1 

For X'jyfl'', Algorithm 7.1 returns Sjmp* = {alive}. 

The following theorem establishes soundness and completeness of our method: 

Theorem 7.3 

Let Simp* be the output of Algorithm 7.1 on inputV = (£pdl, h^,^ U £" U X" U I"). 
Then TT satisfies Postulate PS if and only if Simp* = 0- 

Proof: 

See Appendix C. ■ 

Corollary 7.1 

Let Simp* be the output of Algorithm 7.1 on inputV^ = {CpoL,h^,S U <?" U Af" U T). 
Then 

1- {CpDL,k^,'SU Simp* U -f:" U -Y" U X") satisfies PS. 

2. T> \= f\ Simp*. 
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Proof: 

Item 1. is straightforward from the termination of Algorithm 7.1 and Theorem 7.3. 
Item 2. follows from the fact that by the if-test in Algorithm 7.1, the only formulas 
that are put in Sjmp* at each execution of the repeat-loop are exactly those that are 
implicit static laws of the current theory, and therefore of the original theory, too. ■ 

Corollary 7.2 

Forallip G ^mlV \= cp if and only if {£cPL,\=^pf_,S U Simp'-) \= <P- 

Proof: 

For the left-to-right direction, let cp G g'm( be such that V \= cp, i.e., S,£", X",!" ^ cp, 
and hence S U Simp*,£",X",I'' \^ cp, by monotonicity By Corollary 7.1-1., we have 
that (£pDL) i^ 1 '5 U 'Simp* US" U X" U I") has no implicit static law. From this it follows 
(-CcPL.hgpL,'? U5,-,„p») 1= (p. 
The right-to-left direction is straightforward by Corollary 7.1-2. ■ 

What shall we do once we have discovered an implicit static law? 

The presence of implicit static laws may indicate too strong executability laws: in 
Example 7.1, we wrongly assumed that tease is always executable. Thus one way of 
"repairing" our theory would be to consider the weaker executability alive — > (tease) T 
instead of (feflse)T in X^""'. 

On the other hand, implicit static laws may also indicate that the inexecutability 
laws are too strong: 

Example 7.2 

Consider P^''"/' such that 5 = 0, S''"'"'^ = {loaded -^ [shoot]^alive], X'^'°°^ = {hasGun -^ 
{shoot)T} and J^'""'' = {[shoot]±}, with '^= {{shoot, ^alive), {shoot, ^walking). For this 
action theory. Algorithm 7.1 returns Sjmp* = {~^hasGun}. 

In Example 7.2, we discovered that the agent never has a gun. The problem here 
can be overcome by weakening [shoot]!, in X^'""'' with ^hasGun — > [shoot] ±.^ 

We can go further on in this reasoning and also argue that the problem may 
be due to a too strong set of effect laws, or even to too strong frame axioms (i.e., 
a too weak dependence relation). To witness, for Example 7.1, if we take off the 
inexecutability ^alive — > [tease]!, and replace the law [tease]walking by the weaker 
alive — > [tease]walking, the resulting action theory would satisfy Postulate PS. In the 



^Regarding Examples 7.1 and 7.2, one might argue that in practice such silly errors will never be 
made. Nevertheless, the examples here given are quite simplistic, and for applications of real interest, 
whose complexity will be much higher, we simply cannot rely on the designer's knowledge about all 
side effects the stated formulas can have. 
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same way, stating the (unintuitive) dependence tease ^^ alive (which means the frame 
axiom ^alive — > [tease]^alive is no longer valid) guarantees satisfaction of PS. (Note, 
however, that this solution becomes intuitive when alive is replaced by awake.) 

To finish, implicit static laws of course may also indicate that the static laws them- 
selves are too weak: 

Example 7.3 

Suppose a computer representation of the line of integers, in which we can be at a 
strictly positive number, positive, or at a negative one or zero, -^positive. Let maxlnt 
and minint, respectively, be the largest and the smallest representable integer number. 
Action goLeft is the action of moving to the biggest integer strictly smaller than the 
one at which we are. Consider the action theory V^ '^ for this scenario such that {ati 
means we are at number i): 

S = {ati — > positive : < i < maxlnt] U {ati — > -^positive : minint < i < 0} 

ggoLeft _ [atminint — > \goLeft]underflow} U {ati — > \goLeft]ati_'\ : i > minint], 

;^goLeft ^ {(^oLe/OT}, 1^"^"^^ = 

with the dependence relation {minint <i< maxlnt): 

{{goLeft,ati), {goLeft, positive), 1 
{goLeft, -^positive), {goLeft, underflow) J 

Applying Algorithm 7.1 to this action theory would give us the implicit static law 
-^[at-i A atz), i.e., we cannot be at numbers 1 and 2 at the same time. 

To summarize, in order to satisfy Postulate PS, an action theory should contain 
a complete set of static laws or, alternatively, should not contain too strong action 
laws (executability, inexecutability or effect laws). We will come back to this point in 
Chapter 9, where we address action theory change. 

Remark 7.1 S U Simp* in general is not intuitive. 

Whereas in the latter example the implicit static laws should be added to S, in the 
others the implicit static laws are unintuitive and due to an (in)executability law that 
is too strong and should be weakened. Of course, how intuitive the modified action 
theory will be depends mainly on the knowledge engineer's choice. 
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7 A No Implicit Inexecutability Laws 

Let P^^ff be such that S = {walking -^ alive], 8^""' = {[tease]walking}, X^'"'' = l^'"'' = 0, 
and ^^= {{tease , walking)]. V^^l^ in this way satisfies Postulate PS. Now we observe 
that from [tease]walking it follows with S that [tease]alive , i.e., in every situation, after 
teasing the turkey, it is alive: V^^f^'^ \= [tease]alive. Now as tease -/> alive, the status of 
alive is not modified by tease, and we have P^^l*^ \= ^alive — > [tease]^alive. From the 
above, it follows 

P^^f h ^alive -^ [tease] ±, 

i.e., an inexecutability law stating that a dead turkey cannot be teased. But 

S,I^""' ^PL ^alive -^ [tease]±, 

and then 

{jC-pdl, ^dl-'^ UI''"'') \^ --alive ^ [tease]!. 

which means that Postulate PI is violated. Here the formula --alive — > [tease] J- is an 
example of what we call an implicit inexecutability law. 

In the literature, such laws are also known as implicit qualifications [42], and it has 
been often supposed, in a more or less tacit way, that it is a positive feature of frame- 
works to leave them implicit and provide mechanisms for inferring them [78, 79, 113]. 
The other way round, one might argue as well that implicit qualifications indicate that 
the domain has not been described in an adequate manner: the form of inexecutabil- 
ity laws is simpler than that of effect laws, and it might be reasonably expected that 
it is easier to exhaustively describe them.^ Thus, all inexecutabilities of a given action 
should be explicitly stated, and this is what Postulate PI says. 

How can we check whether PI is violated? We can conceive an algorithm to find 
implicit inexecutability laws of a given action a. The basic idea is as follows: for every 
combination of effect laws of the form ( cp i A . . . A cprt) — > [a] (i|j i A . . . Ai|)tt,), with each 
cpi — > [a]\\)i G (?", if (pi A . . . A cprt is consistent w.r.t. to 5, i|)i A ... A i|)n inconsistent 
w.r.t. S, and S,I" ^ (cpi A ... A (pn) — > [a]±, then output (cpi A ... A (pn) — > [fl]-L as 
an implicit inexecutability law. Our algorithm basically does this, and moreover takes 
into account dependence information. 



*Note that this concerns the necessary conditions for executability, and thus it is not related to the 
qualification problem [85], which basically says that it is difficult to state all the sufficient conditions for 
executability of an action. 
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For an example of the execution of the algorithm, take V^^"^ as above. From g^^'^^ 
we get T — > [tease]walking, whose antecedent is consistent with 5. As [^ ^alive — > 
[tease]^alive and S U {walking} \=p^ alive, and because 5, J*''"^'' ^^^_ (T A -^alive) — > 
[tease] ^-, we caught an implicit inexecutability. As there is no other combination of 
effect laws for tease, we end the simulation here. 

Algorithm 7.2 below shows the pseudo-code for that (the reason X" is not used in 
the computation will be made clear in the sequel). 

Algorithm 7.2 Finding implicit inexecutability laws for a 

input: V = (£pdl, [^ , S \J 8" U X" U 1") 

output: Tf , the set of implicit inexecutability laws for a 

1" :=0 

for all t" C 8" do 

for all X £ NewCons[-^^a,S) do 

if V£i e X, « -/> «i and Sa" ^DL ('P^" ^ "X) ^ [«U then 

^Lp = = ^;:„pU{(cp^„A^x)^[«]^} 



Theorem 7.4 (Decidability) 

Algorithm 7.2 terminates. 

Proof: 

Straightforward, as we have assumed S, 8", X", I" and ^^ finite, and NewCons(.) is 
finite (because 5 and i|)^„ are finite). ■ 

Example 7.4 

Consider P^"!*^ as given above. Then Algorithm 7.2 returns X/^'^p'^ = {-^alive — > [tease] ±}. 

Nevertheless, applying Algorithm 7.2 is not enough to guarantee Postulate PI, as 
illustrated by the following example: 

Example 7.5 (Incompleteness of Algorithm 7.2 without PS) 

Let V be such that 5 = 0, f" = {p^ ^ [a]p2}, X" = {{a)T], I" = [p^ -^ [a]±}, and 
^^= 0. Then we have V" [= p^ — > [fl]_L, but after running Algorithm 7.2 on V" we have 

{i:PDL,^^^,SUl^Ull^)[^p, ^ [a]±. 

Example 7.5 shows that the presence of implicit static laws (induced by executabil- 
ities) implies the existence of implicit inexecutabilities that are not caught by Algo- 
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rithm 7.2. One possibility of getting rid of this is by considering the weaker version of 
Postulate PI: 

PF (No implicit inexecutability laws - weak version): 

if D" h <P ^ [a]±andlf ^ -cp, then (£pdl, ^□l.'S UZ") h cp ^ M-L 

If a non-trivial inexecutability law for a given action a can be inferred from its respec- 
tive theory, then it should be inferable in PDL from the static and inexecutability laws 
for it alone. 

With an adaptation of Algorithm 7.2 to support a test for satisfiability of an in- 
executability's antecedent, we could guarantee completeness with respect to Postu- 
late PF. However, such a test has the same complexity as checking whether Postu- 
late PS is satisfied. That is the reason we keep abide on PI and require V to satisfy 
Postulate PS prior to running Algorithm 7.2. This gives us the following result: 

Theorem 7.5 

Letlf^^ be the output of Algorithm 7.2 on input V = {Cpoi ,[^,S US" U X" Ul"). If 
V satisfies Postulate PS, then P" satisfies Postulate PI if and only if If^^ = 0. 

Proof: 

See Appendix C. ■ 

With Algorithm 7.2, not only do we decide whether Postulate PI is satisfied, but 
we also get information on how to "repair" the action theory. The set of implicit inex- 
ecutabilities so obtained provides logical and meta-logical information concerning the 
correction that must be carried out: in the first case, elements of I" can be added to 
I"; in the second one, I" helps in properly changing £" or^^. For instance, to correct 
the action theory of our example, the knowledge engineer would have the following 
options: 

1. Add the qualification -^alive — > [tease]± to I^'^"^^; or 

2. Add the (unintuitive) dependence {tease , alive) to '^; or 

3. Weaken the effect law [tease]walking to alive — > [tease]walking in g^^"^'^. 

It is easy to see that whatever she opts for, the resulting action theory for tease will 
satisfy Postulate PI (while still satisfying PS). 
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Example 7.6 (Drinking coffee [57]) 

Suppose a situation in which we reason about the effects of drinking a cup of coffee, 

■jdrink 
coffee 



given by the action theory I'^Xe such that: 



5 gdrink ^ J ^^S^r ^ [drink]happy , 
I salt — > [drink]^happy 



■vdrink -jdrink 



and the dependence relation is 

'^= {{drink, happy), {drink, -^happy)} 

Observe that ^f^^g satisfies PS. Then, running Algorithm 7.2 on this action theory 
will give us if^'"'^ = {(sugar A salt) — > [drink]!.]. 

Remark 7.2 X" U X'^ is not always intuitive. 

Whereas in Example 7.4 we have got an inexecutability that could be safely added 
to X*'""''', in Example 7.6 we got an inexecutability that is unintuitive (just the presence 
of sugar and salt in the coffee precludes drinking it). In that case, revision of other 
parts of the theory should be considered in order to make it intuitive. Anyway, the 
problem pointed out in the depicted scenario just illustrates that intuition is beyond 
syntax. The scope of this work relies on the syntactical level. Only the knowledge 
engineer can judge about how intuitive a formula is. 

In the next chapter, we revisit our postulates in order to strengthen them to the 
case where more than one action is under concern, and thus get results that can be 
applied to whole action theories. 
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Chapter 8 

where our method becomes a Swiss Army knife 



Generalizing 

Modularity and Exploiting It 



All generalizations are dangerous, even this one. 

— Alexandre Dumas 

In this chapter, we generaUze Postulates PC, PS and PI to action theories as a 
whole, i.e., considering all actions of a domain, and prove some results that follow 
from that. We also investigate whether our set of postulates can be augmented in 
order to get a more refined notion of modularity. We close the chapter showing the 
benefits we get from domain descriptions that are modular in our sense. 

8.1 Postulates for Multiple Action Theories 

Go as far as you can see, and when you get there, you will see farther 

— Anonymous 

We have seen the importance satisfaction of Postulates PC, PS and PI may have in 
describing the action theory of a particular action a. However, in applications of real 
interest, more than one action is involved, and thus a natural question that could be 
raised is "can we have similar meta-theoretical results for multiple action theories?" 

Given a dynamic domain, we define S = Uaesict^"' '^ — Uae^d'^"' ^^'^ -^ ~ 
Ufleact-^"- ^1^ these sets are finite, because 2lct is finite and each of the £", X", I" is 
finite. We here redefine action theories. 

89 
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As I told earlier, I never repeat anything. 

Definition 8.1 (Action theory) 

An action theory is a tuple V = (£pdl , b. , '^)/ where T = S \JS iJ X \Jl. 

Given that, a generahzation of Postulate PC for whole action theories is quite easy 
and has no need for justification: 

PC* (Logical consistency): P ^ -L 

The whole action theory should be logically consistent. 
Generalizing Postulate PS will give us the following: 

PS* (No implicit static laws): if D |= ^/ then (£cpl, Ixpl'*^^ '^ ^ 

If a classical formula can be inferred from the whole action theory, then it should be 
inferable from the set of static laws alone. We have the following results: 

Theorem 8.1 

V satisfies Postulate PS* if and only ifV satisfies Postulate PS for all a G 2lct. 

Proof: 

(=>): Straightforward: Suppose that for some a € 2lct V" does not satisfy PS. Then 
there is cp G g-tnl such that D" h cp and (£cpl, ^^p|_,5) ^ cp, i.e., S,£\A:\I'' [^ cp 
and iS ^ (p. Of course S,£,X ,1 [^ cp, by monotonicity, and then V \= (p, but still 
(£cPL) hpp, )'5) ^ (p. Hence P does not satisfy PS*. 

(<=): Suppose V does not satisfy PS*. Then there is cp G g'm[ such that V \= (p and 
(£cPL, l=gpL''^^ ^ f' ^■^■' '5)^)'^)2^ \^ <P and iS ^ cp. cp is equivalent to cpi A . . . A 
cpn, with cpi , . . . , (pn G 5^m[ and such that there is at least one cpi such that 5 ^ cpi 
(otherwise S \= cp). Because the logic is independently axiomatized, there must be 
some fl G 2lct such that iS,f , A"",!"" \^ cpi. From this and {CcPL,\=^pi,S) ^ (pi it 
follows that V" does not satisfy PS. ■ 

Corollary 8.1 

V satisfies Postulate PS* if and only if the big model for V is a model ofV. 

Proof: 

The proof follows from Theorems 7.1 and 8.1. ■ 
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Theorem 8.2 

IfT> satisfies PS*, then V satisfies PC* if and only ifV satisfies PC for all a G 2lci. 

Proof: 

Let V satisfy PS*. 

(=>): Suppose that V does not satisfy PC, for some a € 2lct. Because V satisfies PS*, 
V satisfies Postulate PS (Theorem 8.1), and then {CcPL,\^pi,S) \= _L. From this it 
follows that T> \= 1. (by monotonicity) and then V does not satisfy Postulate PC*. 

(<=): Suppose V does not satisfy PC*. Then V \= J.. Because V satisfies Postulate PS*, 
(^CPL, ^^pL''^) ^ -L- Since 2tct ^ 0, there is some a G 2lct such that V" \= ±. ■ 

A more general form of Postulate PI can also be stated: 
PI* (No implicit inexecutability laws): 

if Ph cp^ [a]±, then {£poL,^^^,S Ul) ^ (p ^ [a]± 

If an inexecutability law can be inferred from the whole action theory, then it should 
be inferable in PDL from the static and inexecutability laws alone. 

Note that having that V" satisfies PI for all a £ 2lct is not enough to V satisfy PI* 
if there are implicit static laws. To witness, let 8 = 6"^ = 0, X'^^ = {(fli)T}, and 
X"! = {cp ^ [fli]-L}. Let also e"^ = X''^ = I"^ = 0, and let'^= 0. Observe that both P"' 
and V^ satisfy PI, but D h cp ^ [aJ-L and (£pdl, ^^l''^ UX) ^ cp ^ [aJ-L. 

Nevertheless, under PS* the result follows: 
Theorem 8.3 

Let V = (£pDL, [^,Syj8yjX yjl) satisfy Postulate PS*. V satisfies Postulate PI* if 
and only ifV = (£pdl ,[^,S U S" U X" UI") satisfies Postulate PI for all a G 2lci. 

Proof: 

See Appendix D. ■ 

In the next section we make a step toward an attempt of amending our modularity 
criteria by investigating possible extensions of our set of postulates. 

8.2 Can We Ask for More? 

Can we augment our set of postulates to take into account other modules of action 
theories, or even other meta-theoretical issues in reasoning about actions? That is the 
topic we discuss in what follows. 
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Postulates about Action Effects 

It seems to be in line with our postulates to require action theories not to allow for the 
deduction of new effect laws: if an effect law can be inferred from an action theory 
(and no inexecutability for the same action in the same context can be derived), then 
it should be inferable from the set of static and effect laws alone. This means that we 
should have: 

PE (No implicit effect law^s): 

if P 1= ^ — > [a]'^ and P ^ cp — > [fl]_L, then (£pdL) [^,S U£) \= (p ^ [a]-\\> 

But consider the action theory V = (£pdL) \^ , T) such that: 

I loaded — > [shoot]^alive , 1 

S = (D, £ = < ' } 

I [^loaded A alive) — > [shoot]alive J 

X = {hasGun — > {shoot)T}, 1 = {-^hasGun — > [shoot]±}, 

'^= {{shoot, ^alive)} 

Such a domain description satisfies Postulates PS* and PI*, but does not satisfy PE. 
Indeed: 

T> \= -^hasGunV loaded — > [shoot]^alive 



and 



but 



V ^ -^hasGun V loaded — > [shoot]±, 



(-CpDL) ^,3 ^ £) ¥= ~^hasGun V loaded — > [shoot]^alive 
So, Postulate PE would not help us to deliver the goods. 

Another possibility of improving our modularity criteria could be: 

P_L (No unattainable effects): 

if (p — > [a]i|) € £, then 2? ^ cp — > [fl]_L 

This expresses that if we have explicitly stated an effect law for a in some context, 
then there should be no inexecutability law for the same action in the same context. 
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It is straightforward to design an algorithm which checks whether this postulate is 
satisfied. We do not investigate this further here, but just observe that the slightly 
stronger version below leads to unintuitive consequences: 

P_L' (No unattainable effects - strong version): 

if (-CpDL) [^,<S ^ £) \= <p ^ [a]'^, then 2? ^ cp — > [fl]_L 

Indeed, for the above action theory we have 

£ [^ {^hasGun A loaded) — > [shoot]^alive , 

but 

V \= i^hasGun A loaded) — > [shoot]±. 

This is certainly too strong. Our example also illustrates that it is sometimes natural 
to have some "redundancies" or "overlaps" between £ and I. Indeed, as we have 
pointed out, inexecutability laws are a particular kind of effect laws, and the distinc- 
tion here made is conventional. The decision of considering them as strictly different 
entities or not depends mainly on the context. At a representational level, in the most 
part of this work, we preferred to keep them separated, while in Algorithm 7.1 we 
have mixed them together in order to compute all the consequences of an action (cf. 
Chapters 4 and 9). 

In what follows we address the problem of completing the set of executability laws 
of an action theory. 

Maximizing Executability 

As we have seen, implicit static laws only show up when there are executability laws. 
So, a question that naturally raises is "which executability laws can be consistently 
added to a given action theory?" 

A hypothesis usually made in the literature is that of maximization of executabili- 
ties: in the absence of a proof that an action is inexecutable in a given context, assume 
its executability for that context. Such a hypothesis is formally captured by the fol- 
lowing postulate: 
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PX+ (Maximal executability laws): 

if D^ cp^ [a]±, then {Lpdl,^^^,^ U X) ^ (p ^ {a)T 

Such a postulate expresses that if in context cp no inexecutability for a can be inferred, 
then the respective executability should follow in PDL from the executability and 
static laws. 

Postulate PX"*" generally holds in nonmonotonic frameworks, and can be enforced 
in monotonic approaches such as ours by maximizing X. We nevertheless would like 
to point out that maximizing executability is not always intuitive. To witness, suppose 
we know that if we have the ignition key, the tank is full, . . ., and the battery tension 
is beyond lOV, then the car (necessarily) will start. Suppose we also know that if the 
tension is below 8V, then the car will not start. What should we conclude in situations 
where we know that the tension is 9V? Maximizing executabilities makes us infer that 
it will start, but such reasoning is not what we want if we would like to be sure that 
all possible executions lead to the goal (cf. Section 1.1). 

We do not investigate this further here, and in the rest of the chapter we emphasize 
the main results that we obtain when our modularity principle is satisfied. 

8.3 The Role of Modularity in Reasoning 

We start by generalizing the definition of modularity for multiple action theories. 

Oh, deja vul 
— Neo, in Matrix 

Definition 8.2 (Modularity) 

LetV = {Cpoi,[^,T) be an action theory such thatT = S[J£[JX[JI.V is modular 
if and only if 

1 P h (p implies {Ccpl, ^^pl-'^) ^ ^ 

2. P h cp -> («)T implies (£pdl, I=pdl''^ '-' '^) 1= ^P -> («)T 

3. V \= (p ^ [a]± implies (£pdl, \^^^_,SuI) \= <p ^ [a]± 

4. V \= (p ^ [fl]\|) implies (£pdl, ^,S U£ UI) \= (p ^ [a]^]> 
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In what follows, we see how modularity can be reduced to our base postulates. 

Theorem 8.4 

If V satisfies Postulate PS*, then V h -L i/ and onij if (£cpl, hgpL, 5) \= _L. 

This theorem says that if there are no implicit static laws, then consistency of an action 
theory can be checked by just checking consistency of S. An immediate consequence 
is that consistency of a new learned information cp w.r.t. the whole description can be 
checked by just checking consistency of iS U {cp}. 

Progress isn't made by early risers. It's made by lazy 
men trying to find easier ways to do something. 

— Robert Heinlein 

Theorem 8.5 

IfV = {Cpoi,^,S U <? U -Y U Z) satisfies Postulate PS% then V \= 'p ^ [a]^\) if and 
only if {jCpDL,k^,S U S" UI^) h (p ^ [a]^\). 

Proof: 

See Appendix D. ■ 

This means that under PS* we have modularity inside £, too: when deducing the 
effects of a, we need not consider the action laws for other actions. 

Versions of Theorem 8.5 for executability and inexecutability can be stated as well: 

Theorem 8.6 

IfV = (£pDL, [^,S USUX UI) satisfies Postulate PS*, then V \= (p ^ {a)T if and 
oni7if(£pDL,^DL''^UA"') h cp^ (fl)T. 

Proof: 

See Appendix D. ■ 

Corollary 8.2 

Postulate PX is a consequence o/PS. 

Proof: 

Straightforward. ■ 

Hence, Item 2 in Definition 8.2 is subsumed by Item 1. With this and Theorem 8.5 
above we get that modularity of action theories in reasoning about actions amounts 
to having neither implicit static laws nor implicit inexecutability laws in the theory. 
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Theorem 8.7 

IfV is modular, then P |= tp — > [a]± if and only if (£pdli l=pQ|_ > <S U I") h <P — > W-L- 

Proof: 

(=>): If P 1= <P — > M-L/ then S,£,X ,1 [^ (p — > [fl]_L, and from PS* and Theorem 8.5 
we have SfS",!" ^ <p — > [a]±. From this and PI* we get 3,1" |=pp|_ cp — > [fl]_L, from 
what the result follows. 

(<=): Suppose P ^ cp — > [fl]_L, i.e., 5,f ,A',Z ^ (p — > [fl]±. Then there is a ^^- 
model ^ such that |= iSAfA^AX and ^ cp — > [a]-L. Then, given a, we have 
\^S A f" A ;t"' AX", and then \^S hX". Moreover, by definition, ^ is a PDL-model. 

Hence^.X^^PL 'P ^ [fl]±, and then (£pdl, ^dl-'^ U^") b^ (p ^ [fl]±. ■ 

In Theorems 8.6 and 8.7, modularity guarantees that no dependence is needed to 
derive, respectively, executabilities and inexecutabilities. 

Remark 8.1 There exist action theories T) not satisfying Postulate PS* such that both 

X» h cp ^ [fl]ii)and (£pDL,h^,'5Uf''UX'') ^ cp ^ Mij). 

As an example, for V^^^ such that 

f [tease]walking, \ 

S = {walking — > alive}, o = < > , 

I loaded — > [shoot]^alive , J 



and 



we have that 



but 



X = {{tease)T}, I = {-^alive — > [tease]±} 

{{shoot, ^loaded), {shoot, ^alive), 1 
{shoot , -^walking) , {tease , walking) J 

V \= -^alive — > [shoot]alive , 

(£PDL, h ,5 U ^stoof ^jstoof^ ^ _^;-^g ^ [shoot]alive. 



Let^«i--''n = y^^.^^^«,^^«, ,...,«. = U^^.^^A-^SandX"!--"- = Ui<i<n^''^- Un- 
der Postulate PS*, deduction of an effect of a sequence of actions a i ; . . . ; flri (prediction) 
needs neither the effect and inexecutability laws for actions other than a-\, . . . , a^, nor 
the executability laws of the domain: 
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Theorem 8.8 

IfV = {CpDi,[^,S[j£[JX[Jl) satisfies Postulate PS*, thenV h <P ^ [fli; . . .;fln]^|) if 
and onij if (£pDL,b^''5U^''i •■■■•"" uX"! -•'"") h <P ^ [ay,. . .■,a,^]^\>. 

Proof: 

See Appendix D ■ 

The same result holds for testing inexecutability of a sequence of actions: 

Corollary 8.3 

IfV = {£pDi,[^,S[j£[JX UI) satisfies Postulate PS*, then V \= (p ^ [ay,. . .■,an]± 
if and only if {CpDL,k^,S U £"' '-'"^ UX"! -••"") h (p ^ [ay. . .■,a,^]±. 

Proof: 

Straightforward, as a special case of Theorem 8.8. ■ 

The next theorem shows that our notion of modularity is also fruitful in plan vali- 
dation: 

Theorem 8.9 

IfV = (£pDL ,[^,S[JS[JX[JI) satisfies Postulate PS*, then D h cp ^ (fli ; • • • ; fln)i|^ 
if and only if {CpDL,k^,S U £"' '-'"^ U ^"i -••"" uX"'--"") h cp ^ {ay...;an)^\>. 

Proof: 

See Appendix D. ■ 

And as a consequence, we also optimize testing executability of a plan: 

Corollary 8.4 

IfV = {CpDLyk^yS U £ U X UI) satisfies Postulate PS*, thenV h cp ^ (ar,. . . ;fln.)T 
if and only if {£pDL,k^,S U £^^ '-'"^ U ;t"'i -••"" uX"'--"") h cp ^ (hi; . . . ;fl^)T. 

Proof: 

Straightforward, as a special case of Theorem 8.9. ■ 

Theorems 8.8 and 8.9 together with Corollaries 8.3 and 8.4 suggest that we can 
simulate modularization by sub-domains [77]: If ({fli , . . . , Un}, ^top ') is a sub-domain 
for some «pwp' C qjtop, then (£pdl, h^.-SU-S"! •-•"'^ ^p^a,,...,a„ UX"! '-'"") corresponds 
to the module for {{a-\, . . . , a-n}, ^rop ') in Lifschitz and Ren's sense (cf. Section 10.2). 

In the following chapter, we investigate the role modularity plays when the do- 
main description has to be changed. 
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Chapter 9 

where we cut, crop and paste with our Swiss Army knife 



Towards Action Theory Change 



Education consists mainly in what we have unlearned. 

— Mark Twain 

We here address the problem of changing action theories and define a general 
method based on contraction of formulas. We present the semantics of our theory 
change and define syntactical operators for contracting a domain description. We 
establish soundness and completeness of the operators w.r.t. the semantics for de- 
scriptions that satisfy our principle of modularity. We also investigate an example of 
changing non-modular domain descriptions. 

9.1 Motivation 

Suppose a situation where an agent has always believed that if the light switch is up, 
then there is light in the room. Suppose now that someday she observes that even 
if the switch is in the upper position, the light is off. In such a case, the agent must 
change her beliefs about the relation between the propositions "the switch is up" and 
"the light is on". This example is an instance of the problem of changing propositional 
belief bases and is largely addressed in the literature about belief revision [37] and 
belief update [67]. 

Next, let our agent believe that whenever the switch is down, after toggling it, 
there is light in the room. This means that if the light is off, in every state of the world 
that follows the execution of toggling the switch, the room is lit up. Then, during a 
blackout, the agent toggles the switch and surprisingly the room is still dark. 

Imagine now that the agent never worried about the relation between toggling 
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the switch and the material it is made of, in the sense that she ever beUeved that just 
toggHng the switch does not break it. Nevertheless, in a stressful day, she toggles the 
switch and then observes that she had broken it. 

Completing the wayside cross our agent experiments in discovering the world's 
behavior, suppose she ever believed it is always possible to toggle the switch, pro- 
vided some conditions like being close enough to it, having a free hand, that the switch 
is not broken, etc, are satisfied. Then, in a beautiful April fool's day, she discovers that 
someone has glued the switch and consequently it is no longer possible to toggle it. 

The last three examples illustrate situations where changing the beliefs about the 
behavior of the action of toggling the switch is mandatory. In the first one, toggling 
the switch, once believed to be deterministic, has now to be seen as nondeterministic, 
or, alternatively, to have a different outcome in a specific context (e.g. if the power 
station is overloaded). In the second example, toggling the switch is known to have 
side-effects (ramifications) one was not aware of. In the last example, the executability 
of the action under concern is questioned in the light of new information showing a 
context that was not known to preclude its execution. 

Such cases of theory change are very important when one deals with logical de- 
scriptions of dynamic domains: it may always happen that one discovers that an ac- 
tion actually has a behavior that is different from that one has always believed it had. 

Up to now, theory change has been studied mainly for knowledge bases in classi- 
cal logics, both in terms of revision and update. Only in a few recent works it has been 
considered in modal logics, viz. in epistemic logic [48], and in action languages [31]. 
Recently, some works [106, 62] have investigated revision of beliefs about facts of the 
world. In our examples, this would concern e.g. the current status of the switch: the 
agent believes it is up, but is wrong about this and might subsequently be forced to 
revise her beliefs about the current state of affairs. Such revision operations do not 
modify the agent's beliefs about action laws. In opposition to that, here we are inter- 
ested exactly in such modifications. Our aim in this chapter is to make a step toward 
that issue and propose a framework that deals with contraction of action theories. 

9.2 Models of Contraction 

When a domain description has to be changed, the basic operation is that of contrac- 
tion. (In belief-base update [116, 67] it has also been called erasure.) In this section, we 
define its semantics. 
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For the sake of presentation, as in Chapter 4 we here consider inexecutability laws 
as special cases of effect laws (those whose effect is _L). It can be seen that doing things 
this way does no harm to the theoretical results we have obtained so far. 

In general, we might contract by any formula O. Here we focus on contraction 
by one of the three kinds of laws. We therefore suppose that O is either cp, where (p 
is classical, or cp — > [fl]i|), or cp — > {a)T. The contraction of a model ./^ = {W,R) by 
O results in a set of models each of which is a minimal modification of ^ that is no 
longer a model of O. 

For the case of contracting static laws, we resort to existing approaches in order to 
change the set of static laws. In the following, we consider any belief change operator 
such as Forbus' update method [36], or the possible models approach [116, 117], or 
WSS[53]orMPMA[27]. 

Contraction by cp corresponds to adding new possible worlds to W. Let be a 
contraction operator for classical logic. 

Definition 9.1 (Semantics of classical contraction) 

Let ^ = {W,R) be a PDL-model and cp a classical formula. The set of mod- 
els resulting from contracting ^ by <p is the singleton .^~ = {{W' ,R)] such that 
W' = W Q valuations[(p). 

For example, consider the model ^ in Figure 9.1 (note that 1= Pi — > P2) and 
suppose that we want to contract .^ by the static law p^ — > ^2- ^^^ result is depicted 
by ^' in Figure 9.1, with .^' G -J^v ^v ■ 




( ^PvP^ 



^ 



T2) 



(^vP^ 




(^p^^ 



Qp^ 



T2 



D 



(pi-^Pa) 



Figure 9.1: Contraction of a model by a static law. 

Observe that the accessibility relation R should, a priori, change as well. Figure 9.2 
shows two models resulting from contracting ^ in Figure 9.1 by the static law p^ — > P2 
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in which R has been changed so that we have arrows leaving the world just added. 
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Figure 9.2: Contraction of a static law: adding leaving arrows to the new world. 

The reason for changing R is that otherwise contracting a classical formula may 
conflict with X . For instance, if ^cp — > (fl)T E X and we contract by cp, the result 
may make X untrue. However, given the amount of information we have at hand, 
we think that whatever we do with R (adding or removing edges), we will always be 
able to find a counter-example to the intuitiveness of the operation, since it is domain 
dependent. For instance, adding edges for a deterministic action may render it non- 
deterministic. Deciding on what changes to carry out on R when contracting static 
laws depends on the user's intuition, and unfortunately this information cannot be 
generalized and established once for all. We here opt for a priori doing nothing with 
R and postponing correction of executability laws. 

Action theories being defined in terms of effect and executability laws, changing 
an action theory will mainly involve changing one of these two sets of laws. Let us 
consider now both these cases. 



Suppose the knowledge engineer acquires new information regarding the effect of 
action a. Then it means that the law under consideration is probably too strong, i.e., 
the expected effect may not occur and thus the law has to be weakened. Consider e.g. 
-■wp — > [toggle]light, and suppose it has to be weakened to the more specific {^up A 
^blackout) — > [toggle]light } In order to carry out such a weakening, first the designer 
has to contract the set of effect laws and second to expand the resulting set with the 
weakened law. 



^The other possibiUty of weakening the law, i.e., replacing it by -^up — > [toggle]{light V -flight) looks 
silly. We were not able to find examples where changing the consequent could give a more intuitive 
result. In this sense, we prefer to always weaken a given law by strengthening its antecedent. 
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Contraction by cp — > [a]^\) amounts to adding some "counter-example" arrows from 
cp-worlds to ^i|)-worlds. 

Definition 9.2 (Semantics of effect contraction) 

Let ^ = {W,R) be a PDL-model and cp — > [fl]i|) an effect law. The models resulting 

from contracting ^ by (p ^ [a]\\> is ^~^^^-^.={{W, RuR'a) : K^ C {(w,w') :^ cp}}. 

Figure 9.3 depicts the three resulting models of contracting ^pj — > [a]p2 in the 
model ^ of Figure 9.1. 
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Figure 9.3: Contraction of model .^ in Figure 9.1 by an effect law. 



Suppose now the knowledge engineer learns new information about the exe- 
cutability of a. This usually occurs when there are executability laws that are too 
strong, i.e., the condition in the theory guaranteeing the executability of a is too weak 
and has to be made more restrictive. Let e.g. {toggle)T be the law to be contracted, 
and suppose it has to be weakened to the more specific -^broken — > (toggle)!' . To im- 
plement such a weakening, the designer has to first contract the set of executability 
laws and then to expand the resulting set with the weakened law. 

Contraction by cp — > (fl)T corresponds to removing some arrows leaving worlds 
where cp holds. Removing such arrows has as consequence that a is no longer always 
executable in context cp. 

Definition 9.3 (Semantics of executability contraction) 

Let M = {W,R) be a PDL-model and cp — > {a)T an executability law. The set of 
models resulting from contracting ^ by cp — > {a)T is Ji~^ , > ^ = {( W, R\Ra) : i?^ C 
{(w,w') : wRaw' and ^ cp}}. 
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Figure 9.4 illustrates contraction of model ^ in Figure 9.1 by the executability 
p^ — > (fl)T. (Observe that, in this example, p^ — > [fl]_L has not become true in ^~^,,^, 
but it is not hard to imagine examples where an inexecutability becomes valid when 
contracting an executability law.) 
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Figure 9.4: Contraction of model ./# in Figure 9.1 by an executability law. 

In the next section, we make a step toward syntactical operators that reflect the 
semantic foundations for contraction. 



9.3 Contracting an Action Theory 

Having established the semantics of action theory contraction, we can turn to its syn- 
tactical counterpart. 

Let V = (/^PDL, t^ , <S U f U A") be an action theory and O a PDL-formula. By V~ 
we denote the action theory resulting from the contraction of P by O . 

Contracting a theory by a static law cp amounts to using any existing contraction 
operator for classical logic. Let 9 be such an operator. Moreover, we also need to 
guarantee that cp will not continue to follow from E, X and ^^, i.e., in the case cp is 
an implicit static law (cf. Sections 7.3 and 9.4). We define contraction of a domain 
description by a static law as follows: 

Definition 9.4 (Contraction of a static law) 

LetV = (/:pDL,b^,5u£:u^). v- = (/:pDL,b..'5"U£:u^-), whereas- = 5e cp 
and X-=(X\X")[J{{ipiA<p)^ {a)T : cpt -^ {a)T G X"}. 

For example, contracting the law up — > light in our running scenario, besides 
changing S, would give us X~ = {[^up V light) — > {toggle)T], so that the old exe- 
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cutabilities are still satisfied in the new possible state {up, flight} that is intended to be 
added at the semantical level. 

To contract a theory by cp — > [a]'^, for every effect law in V, we must ensure that a 
still has effect i|) whenever cp does not hold, and change ^^ so that a may have -'i]) as 
outcome. This is enough to guarantee that the law has been contracted. The operator 
below formalizes this: 

Definition 9.5 (Contraction of an effect law) 

LetV = (£pDL,b.'5u£:uA'). V-^^^-^^ = {CpDL,k.,,Su£-UX), where S- = 
i£\£'')U{{(piA^(p) ^ [a]^\>i : (pi^ [a]^\>i e £"1 and^'=^ U({a} x 2it). 

If T>i-i^^ denotes our running example such that 

S = {up ^ light], £ = 1^'"'^^''^'''^'''^], 

[ up -^ [toggle]^up J 

^ ,/, , .^, f {toggle,light), {toggle, flight),) 

I {iogg^e, up), {toggle, ^up) J 

then contracting the law blackout — > [toggle]light from Vj-i^^ would give us 

{[^up A ^blackout) — > [toggle]up, 1 
{up A ^blackout) — > [toggle]^up J 

{toggle, light), {toggle, -flight), 
{toggle, up), {toggle, ^up), 
{ {toggle, blackout), {toggle, ^blackout) 

Finally, we consider the case of contracting an action theory by an executability 
law cp — > (fl)T. For every executability in V, we ensure that action a is executable only 
in contexts where -'cp is the case. The following operator does the job. 

Definition 9.6 (Contraction of an executability law) 

LetV = (£pDL,b.'5Uf U^). V-^^^^j = (£pDL,b''5U^UA'-), where X- = 
(X\X")U{(<PiA^<p) -^ (fl)T : (pi^ (fl)T G X"]. 

For instance, contracting the executability glued — > {toggle)T from 'D|■^^ would 
give us X~ = {-^glued — > {toggle)T}. 

Now we establish that our operators are correct w.r.t. the semantics. Our first 



106 Towards Action Theory Change 



theorem establishes that the semantical contraction of the models of P by O produces 
models of the contracted theory V^. 

Theorem 9.1 

Let O be a formula that has the form of one of the three laws. For all models J^' , if 
Jl' G Ji- for some. M = (W,K) such that^V, then ^'v'. 

Proof: 

See Appendix E. ■ 

It remains to prove that the other way round, the models of P^ result from 
the semantical contraction of models of P by O . This does not hold in general, as 
shown by the following example: suppose there is only one atom p and one ac- 
tion a, and consider the action theory V = (£pDL,t^,<SU<?U<%') such that 5 = 0, 
f = {p — > [fl]-L}, X = {(fl)T}, and '^= 0. The only model of that action theory is 
■^ = ({{~'p}}){({^p}, {"■?}]}) in Figure 9.5. By definition, ^~ , ,^ = {^}. On the other 
hand, P" , >^ is such that iS='^ = 0, £^={p— > [a]±}, and X = {-■p — > {a)T}. The 
contracted theory has two models: ^ and .^' = {{{p},{~^p}}, ({^p},{~'p})) in Figure 9.5. 
While -'p is valid in the contraction of the models of V, it is not valid in the models of 







Figure 9.5: Incompleteness of contraction. 

Fortunately, we can establish a result for those action theories that are modular. 
The proof requires three lemmas. The first one says that for a modular theory we can 
restrict our attention to its big models. 

Lemma 9.1 

LetV = (^PDL,^^,^ US UX) bemodular ThenV \= O if and only if \^ O for every 
model .y^ = {W,R) ofV such thatW = valuations [S). 

Proof: 

(^): Because V is modular, V satisfies Postulate PS*. By Corollary 8.2, for every 
^ = {W,R) such that W = valuations [S), \^ V. From the hypothesis P h ^, it 
follows 1= O. 
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(^): Suppose D ^ O. Then there is a model ^ = (W,R) such that F 21^ and F ^• 
We can augment ^ to a big model ^' = {valuations {S),R). Because V is modular, 
by Corollary 8.2, it follows \^'v. Clearly \f(D. ■ 

Note that the lemma does not hold for non-modular theories (because the set 

{{W, R) : W = valuations (S)} is empty then). 

The second lemma says that modularity is preserved under contraction. 

Lemma 9.2 

LetV = {£pc\_,[^,S U £ L) X) be modular, and let (^ be a form ula of the form of one 
of the three laws. Then V^ is modular. 

Proof: 

See Appendix E. ■ 

The third one establishes the required link between the contraction operators and 
contraction of big models. 

Lemma 9.3 

Let V = (£pDL ,[^,S yj £ yj X) be modular, let (^ be a formula of the form of one of 
the three laws, and V~^ = {Cpd\_,\=^,,S' D £' L) X'). lf.J{' = {valuations {S'),R') is a 
model ofV~^, then there is a model .J( ofV such that.J^' G J^^. 

Proof: 

Let ^' = {valuations {S'),R') be such that |= V^. We analyze each case. 

Let O be cp, for some propositional cp G 5^m(. Because T> is modular. Lemma 9.1 
gives us that there is a model ^ = {valuations (S),R) such that |= V. Clearly, .^' G 
^~, from soundness of ©. 

Suppose now d) has the form cp — > [fl]i|), for (p,\J) G 5^m[. V being modular. 
Lemma 9.1 gives us that ^ = {valuations {S),R) is such that |= V. Because, when 
contracting effect laws, S' = S,it suffices to choose R and R'J such that R' = RU R'J, 
for some R'J C {{w,w') : ^ cp}, and then .^' G -y^'^i^]^- 

Now let O have the form cp — > {a)T, for some cp G ^ml. From V modular and 
Lemma 9.1, there is .^ = {valuations [S),R) such that |= V. When contracting exe- 
cutabilities, S' = S, hence taking the right R and Rj such that R' = R\ R'J, for some 
Ra" C {[w,w') : wRaw' and ^cp}, we get ^' G -^'^^^^j- ■ 

Putting the three above lemmas together we get: 
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Theorem 9.2 

LetT> = {£pc\_,[^,Su£L)X) be modular, let (^ be a formula of the form of one of the 
three laws, and V~^ = (£pdL) [^,,S' L) £' U X'). For all models .J^' , if ^ V~^, then 
M' € ^^, for some Jl = (W, R) such that |= V. 

Proof: 

From the hypothesis that V is modular and Lemma 9.2, Djjj is modular. Then, ^' = 
{valuations (S ') ,R') is such that |^ D^JJ, by Lemma 9.1. From this and Lemma 9.3, the 
result follows. ■ 

Our two theorems together establish correctness of the operators: 

Corollary 9.1 

LetV = {£pci\_,[^,SL)£L)X) be modular, let (^ be a formula of the form of one of the 
three laws, and V~p = {£pol,\^,,S' US' L) X'). ThenV^ ^ W if and only if for every 
models' such thatJ^' G ^^ for some Ji such that \= V,\= W. 

Proof: 

(=>): Let ^' be such that \= V^. By Theorem 9.2, ^' G ^^ for some ^ such that 
1= v. From the hypothesis P^ |= W, we have |^ W. 

«=): Suppose that V~ ^ W. Then there is a model ^ = {W,R) such that \^V~ and 
^ W. Because V is modular, by Lemma 9.2, X^l^ is modular, too. By Lemma 9.1, ^ 
can be augmented to a big model ^' = {valuations[S'),R) such that ^ V^. Clearly, 
we have ^ W. ■ 

We also give a sufficient condition for the success of a contraction. 

Theorem 9.3 

Let O be an effect or an executability law such that S ^ O.IfV is modular, then 

Proof: 

Suppose T>~^ \= ^. From the fact that V is modular. Corollary 9.1 gives us that ^ O 
for all ^' G ^<J, for some ^ such that |= V. 

Let O be of the form cp — > [a]\\), for (p,\\> £ g'm[. If |= (p — > [a]\\) for every ^' G 
-^"-^Wib' ^^^"^ ^'^^'^ ^°'" *^" = (^)^ U R^) such that R^ = {(w,w') : |= cp}, we have 
1= cp — > [fl]i|). By our semantics, this is the case only if W = valuations {'\\)), in which 
case 5 \^^^ cp -> [a]i|). 
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Let now d? have the form cp — > (fl)T, for some cp € 5^ml. If ^ cp — > (fl)T for every 

J^' G -^^^ia\-j' then even for .^'^ = (W, 0) G ■^~_^/(j\t' we have ^ cp -> (fl)T. But 
this is true only if W = valuationsi^(p), in which case S \= cp — > (fl)T. ■ 

What is the status of the AGM-postulates for contraction in our framework? First, 
contraction of static laws satisfies all the postulates, as soon as the underlying classical 
contraction operator 9 satisfies all of them. 

In the general case, however, our constructions do not satisfy the central postulate 
of preservation V~^ = V ii V \/= ^ . Indeed, suppose we have a language with only 
one atom p, and a model ^ with two worlds w = {p] and w ' = {-^p} such that wRaW ' , 
w'RaW, and w'Kqw' (Figure 9.6). Then |= P — > [a]^p and ^ [a]^p, i.e., .^^ is a model of 
the effect law p — > [a]^p, but not of [a]^p. Now the contraction -^r~|^ yields the model 
^' such that Ra = W X W. Then ^ p — > [fl]~'p, i.e., the effect law p — > [a]^p is not 
preserved. Our contraction operation thus behaves rather like an update operation. 




Figure 9.6: Counter-example to preservation. 

Now let us focus on the other postulates. Since our operator has a behavior which 
is close to the update postulate, we focus on the following basic erasure postulates 
introduced in [66]. 

KMlCn{V-) C Cn{V) 

Postulate KMl does not always hold because it is possible to make the formula cp — > 
[fl]_L valid in the resulting theory by removing elements of Ra (cf. Definition 9.3). 

KM2(D ^Cn[V-) 

Under the condition that V is modular. Postulate KM2 is satisfied (cf. Theorem 9.3). 

KM3 If Cn(Pi) =CniV2) and^^^ Oi ^ Oi, then Cn(Pi^ J =Cn(V2^^). 

Theorem 9.4 

IfV^ and T>2 are modular and the propositional contraction operator Q satisfies Pos- 
tulate KM3, then Postulate KM3 is satisfied for every PDL-formulas O i , Oj. 
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Proof: 

The proof follows straightforwardly from our results: since Cn(I)-^) = Cn(V2] and 
I^DL ®i ^ ^^' *^^y have, pairwise, the same models. Hence, given ,^ such that 
1= V-^ and h X>2, ^^ and ^^ have the same semantical operations. Because V-^ 
and 1)2 are modular. Corollary 9.1 guarantees we get the same syntactical results. 
Moreover, as the classical contraction operation 9 satisfies Postulate KM3, it follows 
that Cn(Pi -J =Cn(p2i,)- ■ 

9.4 Contracting Implicit Static Laws 

There can be many reasons why a theory should be changed. Following the discussion 
in Chapter 7, here we focus on the case where it has some classical consequence cp the 
designer is not aware of. 

If (p is taken as intuitive, then, normally, no change has to be done at all, unless we 
want to keep abide on the modularity principle and thus make cp explicit by adding it 
to iS. In the scenario example of Section 9.3, if the knowledge engineer's universe has 
immortal turkeys, then she would add the static law alive to S. 

The other way round, if cp is not intuitive, as long as cp is entailed by V, the goal is 
to avoid such an entailment, i.e., what we want is P" ^ cp. In the mentioned scenario, 
the knowledge engineer considers that having immortal turkeys is not reasonable and 
thus decides to change the domain description. 

This means that action theories that are not modular need to be changed, too. 
Such a changing process is driven by the problematic part of the theory detected by 
Algorithm 7.1. 

It seems that in general implicit static laws are not intuitive. Therefore their con- 
traction is more likely to happen than their addition.^ In the example above, the ac- 
tion theory has to be contracted by alive? In order to contract the action theory, the 
designer has several choices: 

• Contract the set S. (In this case, such an operation is not enough, since alive is a 
consequence of the rest of the theory.) 



^In all the examples in which we have found implicit static laws that are intuitive they are so evident 
that the only explanation for not having them explicitly stated is that they have been forgotten by the 
theory's designer (cf. Section 7.3). 

''Here the change operation is a revision-based operation rather than an update-based operation since 
we mainly "fix" the theory. 
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• Weaken the effect law [tease]walking to alive — > [tease]ivalking, since the original 
effect law is too strong. This means that in a first stage the designer has to con- 
tract the theory and in a second one expand the effect laws with the weaker law. 
The designer will usually choose this option if she focuses on the effect precon- 
ditions of actions. 

• Weaken the executability law {tease)T by rephrasing it as alive — > {tease)T: first 
the executability is contracted and then the weaker one is added to the resulting 
set of executability laws. The designer will choose this option if she focuses on 
preconditions for action execution. 

The analysis of this example shows that the choice of what change has to be car- 
ried out is up to the knowledge engineer. Such a task can get more complicated 
when ramifications are involved. To witness, suppose our scenario has been for- 
malized as follows: S = [walking — > alive}, £ = {[shoot]^alive}, X = {{shoot)T}, and 
^^= {{shoot, ^alive)}. From the corresponding action theory, we can derive the inexe- 
cutability walking — > [shoot]!, and thus the implicit static law ^walking. In this case, 
we have to change the theory by contracting the frame axiom walking — > [shoot]walking 
(which amounts to adding the missing indirect dependence shoot '^ ^walking). 

For an account of how elaboration tolerant our theory change method is, we refer 
the reader to the next chapter, where we also discuss about related work on modular- 
ity and update of domain descriptions. 
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Chapter 10 

where we have a small talk with our neighbors 



Discussion and Related Work 



lam a part of all that I have seen. 
— Alfred Lord Tennyson 

In this chapter, we analyze whether our modularity paradigm is in line with the 
requirements that logical modules are expected to satisfy, and also address existing 
work in the literature about the meta-theory of actions. We then investigate the prin- 
ciple of elaboration tolerance in our theory change framework and discuss about other 
techniques for changing a domain description. 

10.1 How Modular our Modules Are 

Here we comment on the properties logical modules should have by assessing how 
our notion of modularity behaves with respect to them. The following criteria were 
compiled by Fodor [34] and Garson [38]. They also correspond to most of the design 
principles commonly found in software engineering. 

Domain specificity: A module is domain specific if it is designed to draw conclusions 
over a limited domain of expertise [38]. Since with our modules we can reason in a set 
of laws concerning only the actions and fluents describing a sub-domain, regardless 
of the rest of the description, we can say that our modules are domain specific. 

Accuracy: A module is accurate if it proves all sentences in its domain of application. 
Our modules are accurate for by satisfying the principle of modularity they can prove 
any formula in their respective domain that also follows from the whole theory. 

Auto-sufficiency: A module should contain all the data it needs to solve problems in 
its domain, so that the only input it needs is the question to be answered [38]. This 
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also relates to accuracy and modularity. Clearly, by guaranteeing that there are no 
implicit laws, our modules possess all the data they need for answering a query. 

Performance: Inferences in the module should be faster than in the whole description. 
First, because the module may use an inference relation less complex than the global 
one (e.g., our module of static laws uses the classical consequence relation h^p^)- Sec- 
ond, the number of formulas of a module is supposed to be significantly smaller than 
that of the whole description, then even if algorithms with exponential complexity are 
used, the size of the problem is small enough to ensure practical response times [38]. 
With the results of Section 8.3, we achieve such an improvement in performance. 

Encapsulation: We achieve encapsulation if modules do not need to access global in- 
formation concerning the problem to be solved. As we have seen along this work, 
static laws are (by definition) laws of the world and (by definition) they must be ac- 
cessed by all modules. Here we got rid of this by putting them inside each module. 
The price to pay is the replication of the same set of static laws in all modules. 

Independence: Modules should be independent in the sense that further modifica- 
tions (elaborations) of the description are carried out with as little disruption as possi- 
ble. This means that additions or removals of modules should not affect the behavior 
of the rest of the system. This relates to the principle of elaboration tolerance [88, 89] 
in reasoning about actions. Despite some attempts of quantifying such an indepen- 
dence [3], that remains an open issue of research. Regarding our modules, we can 
easily see that they depend one upon the others: first, as already expected, because 
of the static laws. Second, because changing laws of one type is very likely to affect 
laws of other types, too (e.g. if we replace hasGun — > {shoot)T in our example by just 
{shoot)T, there would be a new static law, viz. hasGun). Third, since changing a mod- 
ule may add implicit laws into the theory, modularity may have to be checked again. 
Fortunately, with the results of Section 8.3, we can guarantee independence of action 
laws for actions fli , . . . , An from action laws that mention actions other than fli , . . . , Un, 
under the condition that the added module is also itself modular [54]. 

10.2 Other Modularity and Consistency Notions 

A Meta-theory of the Situation Calculus 

Pirri and Reiter have investigated the meta-theory of the Situation Calculus [96]. In a 
spirit similar to ours, they use executability laws and effect laws. Contrarily to us. 
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their executability laws are equivalences and are thus at the same time inexecutability 
laws. As they restrict themselves to domains without ramifications, there are no static 
laws, i.e., 5 = 0. For this setting, they give a syntactical condition on effect laws 
guaranteeing that they do not interact with the executability laws in the sense that 
they do not entail implicit static laws. Basically, the condition says that when there 
are effect laws (pi — > [fl]i|) and (p2 — > [fl]~'i|', then cpi and (pz are inconsistent (which 
essentially amounts to having in their theories a kind of "implicit static law schema" 
of the form-' (cpi Acpj))- 

This then allows them to show that such theories are always consistent. More- 
over, they thus simplify the entailment problem for this calculus, and show for several 
problems such as consistency or regression that only some of the modules of an action 
theory are necessary. 

In the object-oriented Situation Calculus [2, 4], executabilities are as in [96] and the 
same condition on effect laws is assumed, which syntactically precludes the existence 
of implicit static laws. The frame problem is solved using Reiter's solution [100] and 
then is also restricted to domains without static laws. Ramifications are dealt with 
by compiling them away a la Reiter and Lin [80] based on the method given in [91], 
which takes into account only some restricted state constraints. 

In spite of using many of the object-oriented paradigm tools and techniques, no 
mention is made to the concepts of cohesion and coupling [98], which are closely re- 
lated to modularity [57]. In the approach presented in [2], even if modules are individ- 
ually highly cohesive, they are not necessarily lowly coupled, due to the dependence 
between objects in the reasoning phase. We do not investigate this further here, but 
conjecture that this could be done there by, during the reasoning process defined for 
that approach, avoiding passing to a module a formula of a type different from those 
it contains (cf. Chapter 3). 

The present work generalizes and extends Pirri and Reiter's result to the case 
where 5^0 and both these works where the syntactical restriction on effect laws 
is not made. It also constitutes a better approach for domains with ramifications as 
we do not impose any restriction on the domain constraints we can deal with. 

Moreover, by guaranteeing satisfaction of modularity, our domain descriptions 
can be decomposed according to the ideas in [2]. We illustrate this with the example 
from Section 3.2: 

2?i = {C^,[^p^, {[walking^ — > alive ^}, {walking -^, alive]})) 
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P = (£ h (I '^'''^'^^ ^ {tease2)T, 1 .^^ 
'^°'" [ hasGuui — > {shoot2)T J 



/ 



P3 = (£3,k,(< 



^loaded 3 — > [loadslloaded^, 

loaded^ — > [s/ioofaJ-'flZroes, 

[tease z]walking^ 



> , {walking^ , alive 3]) ) 



P4= (£4,^DL'^1 ,. r n, > ,{allVe4})) 

I -^alive4 — > [tease 4] ± J 

(For this example, we assume we have detected all implicit laws of the description in 
Section 3.2 with Algorithm 7.1 and then contracted the theory by the unintuitive static 
law alive.) 

Hence with our approach we have the advantage of a more expressive power, as 
we can reason about inexecutabilities, and a better modularity in the sense that we 
do not combine formulas that are conceptually different (viz. executabilities and inex- 
ecutabilities). Moreover, by guaranteeing nonexistence of implicit laws, many of the 
results presented in the referred work, e.g., conditional independence (cf. Section 3.2), 
transfer to ours. 

Consistency in the Presence of Ramifications 

Zhang et al. [118] have also proposed an assessment of what a good action theory 
should look like. They develop the ideas in the framework of EPDL [119], an extended 
version of PDL which allows for propositions as modalities to represent a causal con- 
nection between literals (cf. Section 6.5). We do not present the details of that, but 
concentrate on the main meta-theoretical results. 

Zhang et al. propose a normal form for describing action theories,^ and investigate 
three levels of consistency. Roughly speaking, a set of laws T is uniformly consistent if 
it is globally consistent (i.e., T ^p^^ -L); a formula O is T -consistent if T ^epdl ^^' 
for T a uniformly consistent theory; T is universally consistent if (in our terms) every 
logically possible world is accessible. 

Furthermore, two assumptions are made to preclude the existence of implicit qual- 
ifications. Satisfaction of such assumptions means the theory under consideration is 



'But not as expressive as one might think: For instance, in modeling the nondeterministic action of 
dropping a coin on a chessboard, we are not able to state [drop](black V white) . Instead, we should write 
something like [drop^^i^^Jblack, [drop^i^.^Jwhite, [drop^^^^^, ^^^.^^hlack and [drop^^^^^, ^^^.^^white, where drop^^^^^, is 
the action of dropping the coin on a black square (analogously for the others) and drop = drop^^^^^, U 
drop ,., Udrop., , ,.,, with "U" the nondeterministic composition of actions. 

reunite rblacK,whue' r 
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safe, i.e., it is uniformly consistent. Such a normal form justifies the two assumptions 
made and on which their notion of good theories relies. 

Given this, they propose algorithms to test the different versions of consistency for 
a theory T that is in normal form. This test essentially amounts to checking whether 
T is safe, i.e., whether T h^pp^ (^)T/ for every action a. Success of this check should 
mean that the theory under analysis satisfies the consistency requirements. 

Although they are concerned with the same kind of problems that have been dis- 
cussed in this work, they take an overall view of the subject, in the sense that all prob- 
lems are dealt with together. This means that in their approach no special attention 
(in our sense) is given to the different components of the theory, and then every time 
something is wrong with it this is taken as a global problem inherent to the theory as 
a whole. Whereas such a "systemic" view of action theories is not necessarily a draw- 
back (we have just seen the strong interaction that exists between the different sets 
of laws composing an action theory), being modular in our sense allows us to better 
identify the "problematic" laws and take care of them. Moreover, the advantage of al- 
lowing to find the set of laws which must be modified in order to achieve the desired 
consistency is made evident by the algorithms we have proposed (while their results 
only allow to decide whether a given theory satisfies some consistency requirement). 

Consistency and Executability 

Lang et al. [72] address consistency of action theories in a version of the causal laws 
approach [83], focusing on the computational aspects. 

To solve the frame problem, they suppose an abstract notion of completion. Given 
a theory T" containing logical information about a's direct effects as well as the in- 
direct effects that may follow (expressed in the form of causal laws), the completion 
of T", roughly speaking, is the original theory T" amended of some axioms stating 
the persistence of all non-affected (directly nor indirectly) literals. (Note that such 
a notion of completion is close to the underlying semantics of the dependence rela- 
tion used throughout the present work, which essentially amounts to the explanation 
closure assumption [102].) 

Their EXECUTABILITY problem is to check whether action a is executable in all 
possible initial states (Zhang et al.'s safety property). This amounts to testing whether 
every possible state w has a successor w' reachable by a such that w and w' both 
satisfy the completion of T". For the Walking Turkey Scenario, the formalization of 
action tease with causal laws is given by: 
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^tease ^ f ^ 'T Walking, 1 

[ -^alive => -^walking J 

where the first formula is a conditional effect law for tease, and the latter a causal 
law in McCain and Turner's sense (cf. Section 6.3). We will not dive in the technical 
details, and just note that the executability check will return "no" for this example as 
tease cannot be executed in a state satisfying ^alive. 

In the mentioned work, the authors are more concerned with the complexity anal- 
ysis of the problem of doing such a consistency test and no algorithm for performing it 
is given, however. In spite of the fact their motivation is the same as ours, again what 
is presented is a kind of "yes-no tool" which can help in doing a meta-theoretical 
analysis of a given action theory, and many of the comments concerning Zhang et al.'s 
approach could be repeated here. 

Another criticism that could be made about both these approaches concerns the 
assumption of full executability they rely on. We find it too strong to require all actions 
to be always executable (cf . Section 8.2), and to reject as bad an action theory admitting 
situations where some action cannot be executed at all. As an example, consider a very 
simple action theory V = {Cp]:,\_,[^,S \J £ \J X \J X), where S = {walking — > alive}, £ = 
{[tease]walking], X = {{tease)T], T = %, and ^^= {{tease , walking)]. Observe that, with 
our approach, it suffices to derive the implicit inexecutability law ^alive — > [tease]^-, 
change T, and the system will properly run in situations where ^alive is the case. 

On the other hand, if we consider the equivalent representation of such an action 
theory in the approach of Lang et al., after computing the completion of T*'^"^'^, if we 
test its executability, we will get the answer "no", the reason being that tease is not 
executable in the possible state where ^alive holds. Such an answer is correct, but note 
that with only this as guideline we have no idea about where a possible modification 
in the action theory should be carried out in order to achieve full executability for 
tease. The same observation holds for Zhang et al.'s proposal. 

Just to see how things can be even worse, let V' be the same action theory as 
above, but with X = {alive — > {tease)T], obtained by the correction of V above with 
the algorithms we proposed. Observe that V' satisfies all our postulates. It is not 
hard to see, however, that the representation of such an action theory in the above 
frameworks, when checked by their respective consistency tests, is still considered to 
have a problem. 

This problem arises because Lang et al.'s proposal do not allow for executability 
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laws, thus one cannot make the distinction between X = {{tease)T}, X = {alive — > 
(tease) T} and ^ = 0. By their turn, Zhang et al.'s allows for specifying executabilities, 
however their consistency definitions do not distinguish the cases alive — > {tease)T 
and {tease)T. 

Modular Action Languages 

Lifschitz and Ren [77] propose an action description language derived from C+ [45] in 
which action theories can also be decomposed in modules. Contrarily to our setting, 
in theirs a module is not a set of formulas for given action a, but rather a description 
of a subsystem of the theory, i.e., each module describes a set of interrelated fluents 
and actions (cf. Section 3.2). As an example, a module describing Lin's suitcase sce- 
nario [78] should contain all causal laws in the sense of C+ that are relevant to the sce- 
nario. Actions or fluents having nothing to do, neither directly nor indirectly, with the 
suitcase should be described in different modules. This feature makes such a decom- 
position somewhat domain-dependent, while here we have proposed a type-oriented 
modularization of the formulas, which does not depend on the domain. 

In the referred work, modules can be defined in order to specialize other modules. 
This is done by making the new module to inherit and then specialize other modules' 
components. This is an important feature when elaborations are involved. In the suit- 
case example, adding a new action relevant to the suitcase description can be achieved 
by defining a new module inheriting all properties of the old one and containing the 
causal laws needed for the new action. Such ideas are interesting from the stand- 
point of software and knowledge engineering: reusability is an intrinsic property of 
the framework, and easy scalability promotes elaboration tolerance. 

Consistency of a given theory and how to prevent (independent or inherited) con- 
flicts between modules however is not addressed. 

Other Logics 

A concept similar to that of implicit static laws was firstly addressed, as far as we are 
concerned, in the realm of regulation consistency with deontic logic [17]. Indeed, the 
notions of regulation consistency given in the mentioned work and that of modularity 
presented in [58] and used here can be proved to be equivalent. The main difference 
between the mentioned work and the approach in [58] relies on the fact that in [17] 
some syntactical restrictions on the formulas have to be made in order to make the 
algorithm that is proposed to work. 
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In [22] an algorithm is proposed to, given a monolithic description of a web ontol- 
ogy in description logic [7], find a good modularization according to criteria similar 
to Garson's. As we have seen, those are stronger than our notion of modularity in 
the sense that a given formula should be derivable only from a single module (cf. 
Section 3.3). This means that applying the method in [22] to reasoning about actions 
would preclude the natural overlapping between modules, that is inherent in reason- 
ing about actions theories. Moreover, modules defined in that way are sub-domain 
oriented and may have any type of formula, what can still difficult the module's main- 
tainability. 

A different approach of the work we presented here can be found in [57], where 
modularity of action theories is assessed from a software engineering perspective in 
the Situation Calculus. 

Based on the results we have seen in Chapter 4, in [59] we have defined a modu- 
larity approach for description logic [7]. Such a notion of modularity we present there 
is related to uniform interpolation for TBoxes [41]. Let concepts[T) denote the concept 
names and roles [T) the role names occurring in a TBox T. Given T and a signature 

S C concepts{T) U roles{T), a TBox T^ over {concepts[T) U roles{T)) \ S is a uniform 
interpolant of T outside S if and only if: 

• T^ 1= C C D for every C C D that has no occurrences of symbols from S . 

(Here, |= denotes the entailment for description logics.) It is not difficult to see that 
a partition {T^} U {T^^ : K^ £ roles(T]} is modular if and only if every T^^ is a 
uniform interpolant of T outside roles(T) \ {Ri). In [111] there are complexity results 
for computing uniform interpolants in ACC. 

Still in the realm of description logics, in [41] a notion of conservative extension is 
defined that is similar to our modularity. There, T^ U 7^ is a conservative extension of T^ 
if and only if for all concepts C, D built from concepts(T^ ] U roles [T^ ), T^ U 7^ |= C C D 
implies T^ h C C D. 

Given our Theorem 4.1, we can show that checking for modularity can be reduced 
to checking for conservative extensions of T^. Indeed, supposing that the signature 
of T^ is the set of all concept names, we have that T is modular if and only if for every 
role Ri, T^^ U T^ is a conservative extension of T^. 
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10.3 How Elaboration Tolerant We Are 

The principle of elaboration tolerance has been proposed by McCarthy [88]. Roughly, 
it states that the effort required to add new information to a given representation (new 
laws or entities) should be proportional to the complexity of the information being 
added, i.e., it should not require the complete reconstruction of the old theory [105]. 

Since then, many formalisms claim, in a more or less tacit way, to satisfy such a 
principle. Nevertheless, for all this time there has been a lack of good formal criteria 
allowing for the evaluation of theory change difficulty and, consequently, compar- 
isons between different frameworks are carried out in a subjective way. 

The proposal by Amir [3] made the first steps in formally answering what diffi- 
culty of changing a theory means by formalizing one aspect of elaboration tolerance. 
The basic idea is as follows: let Vq be the original domain description and let V^ and 
1^2 be two equivalent (and different) descriptions such that each one results from V^ 
by the application of some sequence of operations (additions and /or deletions of for- 
mulas). The resulting theory whose transformation from Vq has the shortest length 
(number of operations) is taken as the most elaboration tolerant. 

Nevertheless, in the referred work only addition/deletion of axioms is considered, 
i.e., changes in the logical language or contraction of consequences of the theory not 
explicitly stated in the original set of axioms are not taken into account. This means 
that even the formal setting given in [3] is not enough to evaluate the difficulty of 
theory change in a broad sense. Hence the community still needs formal criteria that 
allow for the comparison between more complex changes carried out by frameworks 
like ours, for example. 

Of course, how elaboration tolerant a given update /revision method is strongly 
depends on its underlying formalism for reasoning about actions, i.e., its logical back- 
ground, the solution to the frame problem it implements, the hypotheses it relies on, 
etc. In what follows, we discuss how the dependence-based approach here used be- 
haves when expansion is considered. Most of the comments concerning consequences 
of expansion can also be stated for contraction. We do that with respect to some of the 
qualitative criteria given in [89]. In all that follows, we suppose that the resulting 
theory is consistent. 

Adding effect laws: In the dependence-based framework, adding the new effect law 
(p — > [fl]i|) to the theory demands a change in the dependence relation ^^, and hence it 
means changing the consequence relation in P. In that case, the maximum number of 
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statements added to ^^ is card[{l : £ G X) for all x £ NewCons[^\)^S)]) (dependences 
for all indirect effects have to be stated, too). This is due to the explanation closure 
nature of the reasoning behind dependence (for more details, see [14]). Because of 
this, according to Shanahan [105], explanation closure approaches are not elaboration 
tolerant when dealing with the ramification problem. In order to achieve that, the 
framework should have a mechanism behaving like circumscription that automati- 
cally deals with ramifications. This raises the question: "if we had an automatic (or 
even semi-automatic) procedure to do the job of generating the indirect dependences, 
could we say the framework is elaboration tolerant?". We think we can answer pos- 
itively to such a question, since we can semi-automatically generate the dependence 
relation from a set of effect laws with the method in [13]. 

Adding executability laws: Such a task demands only a change in the set X of exe- 
cutabilities, possibly introducing implicit static laws as a side effect. 

Adding static law^s: Besides expanding the set S, adding new (indirect) dependences 
may be required, changing the consequence relation component of the domain de- 
scription (see above). 

Adding frame axioms: If the frame axiom -^i — > [a]^i has to be valid in the resulting 
theory, expunging the dependence a ^^ i should do the job, which in our case means 
a change in the consequence relation. 

Adding a new action nanie: Without loss of generality we can assume the action in 
question was already in the language. In that case, we expect just to add effect or 
executability laws for it. For the former, at most card(2,ii] dependences will be added 
to ^. (We point out nevertheless that the requirement made in [89] that the addition 
of an action irrelevant for a given plan in the old theory should not preclude it in the 
resulting theory is too strong. Indeed, it is not difficult to imagine a new action forcing 
an implicit static law from which an inexecutability for some action in the plan can be 
derived. The same holds for the item below.) 

Adding a new^ fluent name: In the same way, we can suppose the fluent was already 
in the language. Such a task amounts thus to one or more of the above expansions. 
There will be at most 2 x cflrd(2lct) new elements added to ^^. 

Because of forcing formulas to be explicitly stated in their respective modules (and 
thus possibly making them inferable from two or more different modules at once), in- 
tuitively modularity could be seen to diminish elaboration tolerance. For instance. 
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when contracting a classical formula cp from a non-modular theory, it seems reason- 
able to expect not to change the set of static laws S, while the theory being modular 
surely forces changing such a module. However it is not difficult to conceive non- 
modular theories in which contraction of a formula cp may demand a change in S as 
well. To witness, let 5 = {cpi — > cpi} in an action theory from whose dynamic part 
we (implicitly) infer ^(p2. Then, contracting -■cpi keeping ^(p2 would necessarily ask 
for a change in S. We point out nevertheless that, in both cases (modular and non- 
modular), the extra work in changing other modules stays in the mechanical level, i.e., 
in the machinery that carries out the theory modification, and does not augment in a 
significant way the amount of work the knowledge engineer is expected to do. 

10.4 Other Update Methods 

Following [73, 75], Eiter et al. [31] have investigated update of action domain descrip- 
tions. They define a version of action theory update in an action language and give 
complexity results showing how hard such a task can be. 

Update of action descriptions in their sense is always relative to some condi- 
tions (interpreted as knowledge possibly obtained from earlier observations and that 
should be kept). This characterizes a constraint-based update. In the example they 
give, change must be carried out preserving the assumption that pushing the button 
of the remote control is always executable. Actually, the method is more subtle, as 
new effect laws are added constrained by the addition of viz. an executability law for 
the new action under concern. In the example, the constraint (executability of push) 
was not in the original action description and must figure in the updated theory. 

They describe domains of actions in a fragment of the action language C [40]. How- 
ever they do not specify which fragment, so it is not clear whether the claimed advan- 
tages C has over A really transfer to their framework. At one hand, their approach 
deals with indirect effects, but they do not talk about updating a theory by a law with 
a nondeterministic action. 

Eiter et al. consider a theory T as comprising two main components: 7^, the part of 
the theory that must remain unchanged, and 7^, the part concerning the statements 
that are allowed to change. The crucial information to the associated solution to the 
frame problem is always in 7^. 

Given a theory T = T^ U T^, ((T^ U T^),T', C) is the problem of updating T by 
T' C 5 U <5 warranting the result satisfies all constraints in C C 5 U <%". 
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Even though they do not explicitly state postulates for their kind of theory up- 
date, they establish conditions for the update operator to be successful. Basically, they 
claim for consistency of the resulting theory; maintenance of the new knowledge and 
the invariable part of the description; satisfaction of the constraints in C; and also 
minimal change. 

In some examples that they develop, the illustrated "partial solution" does not 
satisfy C due to the existence of implicit laws (cf. their Example 1, where there is an 
implicit inexecutability law). To achieve a solution, while keeping C, some other laws 
must be dropped (in the example, the agent gives up a static law).^ 

Just to see the link between update by subsumed laws and addition of implicit 
static laws, we note that their Proposition 1 is the same as our Corollary 7.1: every 
implicit static law in our sense is trivially a subsumed law in Eiter et al.'s sense. 

With their method, we can also contract by a static and an effect law. Contraction 
of executabilities are not explicitly addressed, and weakening (replacing a law by a 
weaker one) is left as future work. 



^This does not mean however that the updated theory will necessarily contain no implicit law. 
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where we finish to start 



Conclusion 



Not every end is a goal. The end of a melody is not its 

goal; however, if the melody has not reached its end, 

it would also not have reached its goal. A parable. 

— Nietzsche 

Our contribution is twofold: general, as we presented postulates that apply to all 
reasoning about actions formalisms; and specific, as we proposed algorithms for a 
dependence-based solution to the frame problem. 

We have identified and made a critique of the main approaches of logical mod- 
ularity for domain descriptions, pointing out their characteristics and showing why 
they do not completely assess modularity in the sense descriptions in reasoning about 
actions need. 

We have argued that modularity as commonly used in programming or defined 
in works on formal logic are not appropriate in reasoning about actions. In the first 
case because of expressivity restrictions. In the second because modularity of logical 
theories are usually too strong and shows to be of no much aid if the theory is a 
description of a scenario in reasoning about actions 

We have analyzed the principle of modularity for logics in general defined by 
Garson. Such a notion of modularity as defined in [38] and adopted in [22] can be 
reduced to the concepts of cohesion and coupling [108, 98] in software engineering. 
In [57] we have seen the difficulty of requiring a domain description in reasoning 
about actions to satisfy these two principles. 

The main motivation in the original work by Garson is the intractability of consis- 
tency check in classical first-order logic. That is the reason he moves to relevant logic 
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in order to get rid of the principle of explosion and hence get a formal substratum in 
which descriptions fit better with his notion of local completeness. 

The principle of explosion is not a reason on its own to abandon classical logic. 
We agree with Cuenca Grau and colleagues [22] when they say that we can turn our 
attention to consistent theories and give an account of modularity even in the presence 
of the principle of explosion. Since our aim is to point out whether a theory is good 
or not, if it is inconsistent, then it simply cannot be good. Moreover, we focus on how 
to refine modularity, not on how to force modularity to hold for inconsistent theories. 
We have shown that, despite the principle of explosion, and with some amendments, 
we can have a good account of modularity for theories in reasoning about actions. 

We have defined here our concept of modularity of an action theory and pointed 
out some of the problems that arise if it is not satisfied. In particular we have ar- 
gued that the non-dynamic part of action theories could influence but should not be 
influenced by the dynamic one.^ 

We have put forward some postulates, and in particular tried to demonstrate that 
when there are implicit static and inexecutability laws then one has slipped up in 
designing the action theory in question. As shown, a possible solution comes into its 
own with Algorithms 7.1 and 7.2, which can give us some guidelines in correcting an 
action theory if needed. By means of examples, we have seen that there are several 
alternatives of correction, and choosing the right module to be modified as well as 
providing the intuitive information that must be supplied is a task that is up to the 
knowledge engineer. 

Given the difficulty of exhaustively enumerating all the preconditions under 
which a given action is executable (and also those under which such an action can- 
not be executed), it is reasonable to expect that there is always going to be some ex- 
ecu tability precondition cpi and some inexecutability precondition (p2 that together 
lead to a contradiction, forcing, thus, an implicit static law -'((pi A (p2). This is the 
reason we propose to state some information about both executabilities and inexe- 
cutabilities, and then run the algorithms in order to improve the description. 

It could be argued that unintuitive consequences in action theories are mainly due 
to badly written axioms and not to the lack of modularity. True enough, but what we 
have presented here is the case that making a domain description modular gives us 



'it might be objected that it is only by doing experiments that one learns the static laws that govern 
the universe. But note that this involves learning, whereas here - as always done in the reasoning about 
actions field - the static laws are known once forever, and do not evolve. 
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a tool to detect at least some of such problems and correct it. (But note that we do 
not claim to correct badly written axioms automatically and once for all). Besides this, 
having separate entities in the ontology and controlling their interaction help us to 
localize where the problems are, which can be crucial for real world applications. 

In this work we have illustrated by some examples what we can do in order to 
make a theory intuitive. This involves theory modification. We have presented a gen- 
eral method for changing a domain description given a formula we want to contract. 

We have defined a semantics for theory contraction and also presented its syntac- 
tical counterpart through contraction operators. Soundness and completeness of such 
operators with respect to the semantics have been established (Corollary 9.1). 

We have also shown that modularity is a sufficient condition for contraction to be 
successful (Theorem 9.3). This gives further evidence that the notion of modularity is 
fruitful. 

Modularity is not necessarily a property of the underlying logical formalism. It is 
rather a property of descriptions written in such a formalism. The choice of which log- 
ical background to use in formalizing a domain may more or less ease the satisfaction 
of modularity. 

In this work we used a weak version of PDL, but our notions and results can be 
applied to other frameworks as well. It is worth noting however that for first-order 
based frameworks the consistency checks of Algorithms 7.1 and 7.2 are undecidable. 
We can get rid of this by assuming that V is finite and that there is no function symbol 
in the language. In this way, the result of NewCons(.) is finite and the algorithms 
terminate. 

The dependence-based framework we have used here is a simple yet powerful 
account to the frame and ramification problems, within which Reiter's regression 
technique can be applied [26]. We have shown that regression does not necessarily 
build on Successor State Axioms as in Reiter's original theory, which involves quan- 
tification. Moreover, the dependence-based framework has the advantage of having a 
decision procedure in terms of tableau systems [12, 11] (while the Situation Calculus 
contains second-order axioms and is a priori not even semi-decidable). 

We have also presented an example of a scenario having actions with both indeter- 
minate and indirect effects, which leads to counterintuitive results when formalized 
in fluent-indexed approaches. The analysis we have carried out supports the thesis 
that causality should be action-indexed. 
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The problem with such a causal notion is that one must in some way relate ac- 
tions and their indirect effects. Nevertheless, the present work is a step toward a 
solution to the problem of indirect dependences: indeed, if the indirect dependence 
shoot '^ -^walking is not in ^^, then after running Algorithm 7.2 we get an implicit inex- 
ecutability [loaded Awalking) — > [shoot] ±, i.e., shoot cannotheexecutedii loaded Awalking 
holds. Such an unintuitive inexecutability is not in I and thus indicates the missing 
indirect dependence. The general case is nevertheless more complex, and it seems 
that such indirect dependences cannot be computed automatically in the case of inde- 
terminate effects. 

A topic for further investigations could be considering the notion of coherence de- 
fined in [71] as a guideline for "repairing" a given theory. Roughly, given an action 
theory T> and an unintuitive implicit static law cp, the formulas in T that are most likely 
to be revised are exactly those whose utility, in Kwok et al.'s sense, for deriving cp are 
the highest. 

Our postulates do not take into account causality statements linking propositions 
such as in [78, 83], nor the qualification problem. This could be a topic for further 
investigation. 
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Appendix A 



Long Proofs of Chapter 4 



Proof of Theorem 4.1 

Let the underlying logic he a fusion, and let V = (£pdL) I=pol''^^ ^^ ^"''^ ^^^^ ^ ^^ parti- 
tioned. IfV is propositionally modular, then V is modular. 

Let V = (£pDL, hpDL)^) be propositionally modular. Suppose that for some O 
(^PDL.^DL'^^^^"'"'^') ^ O, i.e., r^ U r''^'('^' ^pL O. Hence there is a PDL-model 
^ = {W,R) such that l^r^'^m AT'^, and ^O. This means that there is some w eW 
such that ^ O . We prove that D ^ d) by constructing from .^^ a model .^ ' such that 
^Vand^'o. 

First, as our logic is an extension of classical propositional logic and it is compact, 
propositional modularity implies that for every propositional valuation val C 2^^^ 
which is a model of T^, there is a possible worlds model ^^^al = O^vah^vd) such that 
\= ""' T, and val G W^^h i-e-, for every propositional valuation of T^, there is a model 
of T containing that valuation. 

Second, taking the disjoint union of all these models, we obtain a model ^ ' = 
{W' ,R') such that |= T, and for every propositional valuation val C 2^^^ of T®, there 
is a possible world w' G W' such that w' = val. 

Now, we can use .^ ' to adjust those accessibility relations Ra of .^ whose a does 
not appear in d), in a way such that the resulting model satisfies the rest of the theory 
r \ r''^«(i'). Let ^" = {W",R") be such that 

• W" = {uv : u G W,v G W, and u = v}; 

• if fl G flcf(O), then UvR^'u!^, if and only if uK^u'; 

• iia ^ act(O), then Uv^^'u^/ if and only if vK(,v'; and 



• Uv = U 
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We have W" ^ because |= T^. M" is a model of the underlying logic because the 
latter is a fusion. Then, for the sublanguage constructed from act (O), it can be proved 
by structural induction that for every formula O ' of the sublanguage and every u € W 
and V € W', |= O ' if and only if |= O '. The same can be proved for the sublanguage 
constructed from 2lct \ flct( O ) . As, by hypothesis, T is partitioned, T® and each T" are 
in at least one of these sublanguages, thus we have proved that |= T, and ^ O for 
every V. Hence D ^ d). ■ 

Proof of Theorem 4.4 

An action theory V = (£pdl, I=pdl' -^^ ^'^ modular if and only ifSimp = 0. 

(=>): Suppose Simp = 0- Therefore, for all subsets {cpi — > [fl]i|)i , . . . , (pn, — > Mij^Ti,} of T" 
and all cp' — > (fl)T G T", we have that 

ifr^U{cp',(pi,...,(p^}^PL±,thenr^U{^i,...,x|)^}^PL±. (A.l) 

By Theorem 4.1, it suffices to prove that V is propositionally modular. Therefore, 
suppose T^ ^ (p for some propositional cp. Let W be the set of all propositional 
valuations satisfying T® that falsify cp. As T^ ^.p. cp, T^ U{-'(p} is satisfiable, hence W 
must be nonempty. For every w € W let 

^^(w) = {(pi : cpi — > [fl]i|)i G T" and w satisfies cpi} 

X^(w) = {cpi : cpi — > (fl)T G <¥" and w satisfies cpt} 

We define Ra such that wi?(,w ' if and only if 

• A'«(w)y^0;and 

• w' satisfies i|)i for every cp^ — > [fl]ij)t G T" such that cpi G 5J[,(w). 

We then obtain a model .^ = (W,R). We have that ^T^, by the definition of W. 
Moreover, for every w G W and every cpt — > [fl]ij)i G T", if |= cpi, then, by the definition 
of Rn, \= ^\>i for all w' G W such that wRnw'. We also have that for every w G W and 
every cpt — > (fl)T G T", if ^ cp^, then from (A.l) and the definition of Ra, there exists 
at least one w' such that wRgw'. 

Hence, |= T. Clearly ^ cp, by the definition of W. Thus we have T ^ cp, and 
thenP ^ cp. 

(<=): Straightforward, by the soundness result (Theorem 4.3). ■ 



Appendix B 



Long Proofs of Chapter 5 



Proof of Theorem 5.1 

Let T be the set of global axioms (5.4)-(5.8). Then 

T ^pD|_+ (Va.(Poss(fl) -^ ([flip ^ 

[[a = fli ACond~^[a],p)) V . . . V (fl = anACond~^{an,p)) V 

(p A^(fl = a\ ACond~[a\,p)) A . . . A^(a = a!^ACond~(a!^,p))))))) 

<-> 

(Vfl.([fl]p <-> 

i^Possia) V 

(fl = fli ACond~^[a'\,p)) V . . . V (fl = anACond~^[an,p)) V 

(p A^(fl = fl^' ACond~(flpp)) A . . . A-'(fl = fl(^ ACond~(fl^,p)))))) 

Let (p denote the formula 

(fl = fli ACond'''(fli,p)) V . . . V (fl = fln, ACond"'"(flTT,,p))V 

(p A^(fl = a\ ACond~{a\,p)) A . . . A^{a = fl(^ ACond~(fl(^,p))) 

(— >): We are going to show that 

r ^p^^^ (Vfl.(Poss(fl] ^ ([flip f^ (p))) ^ (Vfl.([fl]p f^ (-Poss(fl) Vcp))) 

1. Poss(fl) — > ([flip <-> cp), from hypothesis 

2. Poss(fl) — > ([flip — > cp], from 1. by classical logic 

3. {Poss{a) A [flip) — > cp, from 2. by classical logic 

4. ( [flip A Poss[a)) — > cp, from 3. by classical logic 
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5. [a]p — > (Poss(fl) — > (p), from 4. by classical logic 

6. Poss(fl) <-> -'[fl]-L, from global axiom (5.4) 

7. ^Poss(fl) — > [fl]_L, from 6. and classical logic 

8. [fl](_L^p),RNon_L^p 

9. [fl]_L — > [fl]p, from K on 8. and modus ponens 

10. ^Poss(fl) — > [a]p, from 7. and 9. by classical logic 

11. Poss(fl) — > (cp — > [fl]p), from 1. by classical logic 

12. (-'Poss(fl) A (p) — > [a]p, from 10. by classical logic 

13. ^Poss(fl) — > (cp — > [fl]p), from 12. by classical logic 

14. {Poss{a) V ^Poss(fl)) — > (cp — > [a]p), from 11. and 13. by classical logic 

15. T — > (cp — > [a]p), from 14. by classical logic 

16. (p — > [fl]p, from 15. by classical logic 

17. i^Possia) V (p) — > [a]p, from 10. and 16. by classical logic 

18. [Poss[a) — > cp) — > [a]p, from 17. by classical logic 

19. [a]p <-> (Possia) — > cp), from 5. and 18. by classical logic 

20. [a]p <-> {^Poss{a) V cp), from 19. by classical logic 

(<— ): We now prove that 

r ^p^^^ (Vfl.([fl]p ^ (-Poss(fl) V cp))) ^ (Vfl.(Poss(fl) ^ ([flip f^ cp))) 

1. [fl]p f-> (-'Poss(fl) V (p), from hypothesis 

2. (-'Poss(fl) V (p) — > [a]p, from 1. by classical logic 

3. [Possia) — > cp) — > [a]p, from 2. by classical logic 

4. Poss(fl) — > (cp — > [fl]p), from 3. by classical logic 

5. [a]p — > (-'Poss(fl) V (p), from 1. by classical logic 
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6. [a]p — > (Poss(fl) — > cp), from 5. by classical logic 

7. ( [a]p A Poss{a)) — > cp, from 6. by classical logic 

8. Poss(a) — > i[a]p — > cp), from 7. by classical logic 

9. Poss(a) — > ([fl]p f-> cp), from 4. and 8. by classical logic 



Proof of Theorem 5.3 

Let the underlying logic be deterministic PDL, -^ be a dependence relation obtained from sets 
causes~^[.) and causes~[.), and let T be the set of global axioms (5.4)-(5.8). Then 

(1) T [^ [a]p <-> -^Poss(a) V p, if a -y^ p and a -/> ^p; 

(2) T [^ [a]p^^Poss(a)\/[pA^Cond~{a,p)),ifay^panda-^^p; 

(3) T [^ [a]p f-> -^Poss(a) V Cond~^(a,p) V p, if a -^ p and a -y^ -^p; and 

(4) T [^ [a]p<r^^Poss[a)VCond~^(a,p)\/{pA^Cond~(a,p)),ifa-^panda-^^p. 

Proving (1): 

(— >): We are about to prove {[a]p A^p) — > -^Poss{a). 

1. ^p — > [fl]-'p, from the hypothesis a 7^ p 

2. [ [a]p A^p) — > ( [a]p A [a]^p), from 1. by classical logic 

3. ( [a]p A [a]^p) — > [a] [p A -^p), by K and classical logic 

4. ( [a]p A [a]-^p] — > [a]_L, from 3. and classical logic 

5. ( [a\p A ^p) — > [a] _L, from 2. and 4. by classical logic 

6. [fl]± — > -'Poss(fl), from global axiom (5.4) 

7. ( [d\p A -^p) — > -^Poss[a), from 5. and 6. by classical logic 

(<— ): We now prove -'Poss(fl) V p — > [a]p. 

1. p — > [fl]p, from the hypothesis a 7^ -'p 

2. -'Poss(fl) — > [fl]_L, from global axiom (5.4) 
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3. [a](±^p),RNon±^p 

4. [a]± — > [a]p, from K on 3. and modus ponens 

5. ^Poss(fl) — > [a]p, from 2. and 4. by classical logic 

6. ^Poss(fl) V p — > [fl]p, from 1. and 5. by classical logic 

Proving (2): 

(— >): Let's show {[a]pA^p) — > -'Poss(fl) and {[a]p ACond~{a,p)) — > ^Poss(fl) 

1. ^p — > [fl]^p, from the hypothesis a -/^ p 

2. ( [fl]p A -'p) — > ( [fl]p A [fl]^p), from 1. by classical logic 

3. ( [a]p A [fl]-'p) — > [fl] (p A -'p], by K and classical logic 

4. ([fl]p A [fl]-'p) — > [fl]±, from 3. and classical logic 

5. [fl]_L — > ^Poss(a), from global axiom (5.4) 

6. ([fl]p A [fl]-'p) — > ^Poss(a), from 4. and 5. by classical logic 

7. ([fl]p A -'p) — > -'Poss(fl), from 2. and 6. by classical logic 

8. Cond~{a,p) — > [fl]^p, by global axiom (5.7) 

9. ( [a]p A Cond~{a,p)) — > ( [fl]p A [a]^p), from 8. by classical logic 

10. ([fl]p A Cond~{a,p)) — > [fl]_L, from 9. and 4. by classical logic 

11. ([fl]p A Cond~{a,p) — > ^Poss(fl), from 10. and 5. by classical logic 

(<— ): We are going to prove -^Poss{a) V (p A^Cond~[a,p)) — > [fl]p. 

1. ^Poss(fl) — > [fl]_L, from global axiom (5.4) 

2. [fl](_L^p],RNon±^p 

3. [fl]_L — > [a]p, from K on 2. and modus ponens 

4. ^Poss(fl) — > [fl]p, from 1. and 3. by classical logic 

5. (p A^Cond~[a,p)) — > [fl]p, from global axiom (5.8) 

6. ^Poss(fl) V (p A -^Cond~{a,p)) — > [fl]p, from 4. and 5. by classical logic 
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Proving (3): 

(— >): We will prove ([a]p A^Cond~^[a,p) A^p) — > -^Poss{a). 

1. [^Cond~^{a,p) A^p) — > [a]^p, by global axiom (5.6) 

2. [[a]p A^Cond~^[a,p) A^p) ^ ( [a] p A [a] ^p), from 1. by classical logic 

3. ( [a]p A [a]^p) — > [a] (p A -■p), by K and classical logic 

4. ([a]p A [fl]-'p) — > [a]_L, from 3. and classical logic 

5. ([fl]p A^Cond'''(fl,p) A-'p) — > [a] ±, from 2. and 4. by classical logic 

6. [fl]± — > -'Poss(fl), from global axiom (5.4) 

7. [[a]p A^Cond~^{a,p) A^p) — > -'Poss(fl), from 5. and 6. by classical logic 

(<— ): We are about to prove -'Poss(fl) V Cond^[a,p) Vp — > [fl]p 

1. ^Poss(fl) — > [fl]_L, from global axiom (5.4) 

2. [fl](_L^p),RNon±^p 

3. [fl]± — > [fl]p, from K on 2. and modus ponens 

4. ^Poss(fl) — > [fl]p, from 1. and 3. by classical logic 

5. p — > [a]p, by hypothesis a ^ ^p 

6. Cond~^{a,p) — > [fl]p, from global axiom (5.5) 

7. ^Poss(fl) V Cond~^[a,p) Vp — > [fl]p, from 4., 5. and 6. by classical logic 

Proving (4): 

(— >): We prove [[a]p A^Cond~^(a,p) A^[p A^Cond~{a,p))) — > -'Poss(fl) 

1. [^Cond~^{a,p) A^p) — > [fl]^p, from global axiom (5.6) 

2. ([fl]p A^Cond~^(a,p) A^p) — > ([fl]p A [fl]-'p), from 1. by classical logic 

3. Cond~{a,p] — > [fl]-'p, by global axiom (5.7) 

4. [[a]p A^Cond~^[a,p) ACond~{a,p)) — > ([fl]p A -'Cond"'"(fl,p) A [fl]-'p), from 3. by 
classical logic 

5. ([fl]p A^Cond~^(a,p) A [a]^p) — > ([fl]p A [a]^p), by classical logic 
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6. [[a]p A -^Cond~^[a,p) A Cond [a,p)) — > {[a]p A [a]^p), from 4. and 5. by classical 
logic 

7. [a]p A^Cond~^[a,p) A^pV [a]p A^Cond~^{a,p) ACond~{a,p) — > [fl]pA[fl]-'p, from2. 
and 4. by classical logic 

8. {[a]p A^Cond~^{a,p) A^ip A^Cond~{a,p))) — > ([fl]p A [a] ^p), from 7. by classical 
logic 

9. ( [a]p A [a]^p) — > [a] [p A -^p], by K and classical logic 

10. [[d\p A [a\^p) — > [fl]_L, from 9. and classical logic 

11. ([fl]p A-'Cond'''(fl,p) A^(p A^Cond~(fl,p))) — > [a] ±, from 8. and 10. by classical 
logic 

12. [fl]± — > -'Poss(fl), from global axiom (5.4) 

13. ([fl]p A^Cond~^[a,p) A^{p A^Cond~{a,p)]) — > -'Poss(fl), from 11. and 12. by 
classical logic 

(<— ): We will prove -^Poss[a) V Cond~^{a,p) V {p A^Cond~[a,p)) — > [fl]p 

1. ^Poss(fl) — > [fl]_L, from global axiom (5.4) 

2. [fl](±^p),RNon±^p 

3. [fl]_L — > [fl]p, from K on 2. and modus ponens 

4. ^Poss(fl) — > [fl]p, from 1. and 3. by classical logic 

5. Cond~^ia,p) — > [fl]p, from global axiom (5.5) 

6. (p A^Cond~[a,p)) — > [fl]p, by global axiom (5.8) 

7. -^Poss[a)V Cond~^[a,p)V {p A^Cond~{a,p)) — > [fl]p, from 4., 5. and 6. by classical 
logic 



Appendix C 



Long Proofs of Chapter 7 



We recall that |= is logical consequence in classical propositional logic, and PI{T'^] 
is the set of prime implicates of the set T^ of classical formulas. 

Before giving the proof of the theorems, we recall some properties of prime im- 
plicates [81, 82] and of the function NewCons[.) [61] (see Section 7.3). Let cp G g^ml, 
T^ C g^mt finite (identified with the conjunction of its formulas), and x be a clause. 
Then 

1. ^p|_ (p <r^ f\PI{(p] [82, Corollary 3.2]. 

2. PliT'") U Nez<;Cons(cp,r^) = PI(T''' A cp) (by definition oiNewCons[.)). 

3. ^pL (T^ A cp) f^ (T^ ANmCons((p,r^)) (from 1 and 2) 

4. If P7((p) ^pi^ X, then there is x' G W((p) such that x' ^^pL X [82, Proposition 3.4]. 

Proof of Theorem 7.3 

Let Simp* be the output of Algorithm 7.1 on input V = (£pdl, [^ , 5 U (5^" U -Y" U X"). Then 
TT satisfies Postulate PS if and only ifSjmp* = 0. 

Let P" = (£pDL, t^ , 5 U <£:" U ;f'' U J") be an action theory for a, and let cp ^ {a)T e 
X", C = 8"^ T, and (f" C C. We define: 

cP(f» = /\{cpi : cpt ^ [fl]i|ji G (?"} 

^^a = l\{^i : (pi -^ [a]^\>i G (f"} 
Moreover, let indep^ = {-^i : a^ i). 
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Lemma C.l 

Letindep'^ C indep^. S U {^^a} U indep'^ |=gp|_ ± if and only if S U NeivCons{-[\)(fi,,S) U 
indep'^ ^PL ^• 

Proof: 

S U {i|)^J U mdep^ ^p|_ ± 

if and only if 

PliS U {i|)^J) U mdep^ ^p^ ± (by Property 1) 

if and only if 

PI[S) UNewCons[\\>^,,S) Uindep'^ hgp|_ -L (by Property 2) 
if and only if 

S U NewCons{-[\)^„ ,S)L) indep'^ \=p^ ± (by Property 1). 

■ 

Lemma C.2 

Let indep'^ C indep^. If S yJNewCons[^^(fi,,S) VJ indep[ [^^^ ^, then there exists x £ 
NeivCons{-i\)^„,S) such thatS UlxJUmdep^ |=gp|_ ±. 

Proof: 

iS UNewCons[^\>(fa,S) Uindep'^ |=gp|_ ± 
if and only if 

PI[S) U NewCons[\\>^a,S) U mdep^ hgp|_ -L (by Property 1) 

if and only if 

PI{S U {^\>^„}) U indep'^ ^p^ ± (by Property 2) 

if and only if 

PI(5 U{4)^„}) ^pL - A^^^^ • ^^^ ^ ^■"'^^P^^ 
if and only if 



PI{SU{^\>^„]) ^pL V^^i : -^i e mdep^} 
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if and only if there exists x € PliS U {ijj^j) such that 

X ^pL V^^^ • "^^ ^ ^^d^P'J (by Property 4) 

if and only if 

(x) U indep'^ ^p|_ ± 

if and only if 

5 U {x} U indep'^ ^pL ±. 



Lemma C.3 

Let indepl C indep^. If we have both S U {(p,ip^o} U indep'^ ^p|_ ± and S U 
NewCons[-^\)^„,S) U indep'^ |=gp|_ ±, then there exists x £ NewCons[-^\)^a,S) such that 
5 U {x} U indep'^ ^pL ±. 

Proof: 

By Lemma C.2 and classical logic. ■ 

Lemma C.4 

Let indep'^ C indep^. If we have both S U {(p,(p^} U indep'^ \^p^ ± and S U 
Nea;Cons(iJ>^„,5) U indep'^ |=gp|_ ±, then there exists x G Nea^Cons(\|)^,5) such that 
both 5 U {cp, (p^J U mdep^ ^p|_ ± and 5 U (x) U mdep^ ^p^ ±. 

Proof: 

Trivially, by Lemma C.3. ■ 

Lemma C.5 

Letindep'^ C indep^. Ifx £ NeioCons(-^\>^„,S] is such thatS L){<p,(p^„}U indep'^ ^^^ ± 
and <S U (x) U indep'^ |^p|_ ±, then both 5 U {cp, cp^„} U {^£i : £i G x and a -/> ^i} ^p|_ ± 
and 5 U {x} U {-£i : i^i £ x and a ^ h} ^p^ ±. 

Proof: 

Let iS U {(p, (P(5-„} U mdep^ \^p^ ± and x £ NewCons{\\)^„,S) be such that 5 U (x) U 
indep'^ ^PL ^• 

If X = -L/ the result is trivial. Otherwise, we have the following cases: 

• liatm(x] ^ atm[indep'^), then the premise is false (and the lemma trivially holds). 

• Iffltm(x) = fltra(mdep^), the lemma holds. 
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Letatmix) C atm[indep'j. Then, from 

iS U {cp, cp^J U indep'^ ^p|_ ± (the hypothesis) 
it follows 

From 

iS U (xl U indep'^ Itpl -*- (hypothesis) 

and because 

S U mdep^ ^p^ ±, 

it follows 

5U{x}U{-£i : £t G X and fl 9^ £t} ^pL ±. 



Lemma C.6 

I/x G Nea;Cons(i|)(^, 5] issuch thatbothiSU{(p, cp(5,}U{-'£i : £i G x andfl -/> ^t} |^pi_ ± 
and 5 U (x) U {^£i : ^t G x and a -/> ^t} ^p|_ ±, then 5 U {cp , cp^„ , ^x) ^rl ^ ^^^^ ^o^ ^^^ 
«i e X, fl ?^ hi- 
proof: 
From 

5U{(p,(p^JU{-£i : £i G X and fl 9^ £i} ^pL ± 

we conclude 

5U{-£t : £i G X and fl 9^ £i} ^pL ±. 

From this and the hypothesis 

5 U {x} U {-«! : £i G X and fl 9^ h} ^p^ ^, 

it follows 

S U i^h : £t G X and fl 9^ M ^p^ -x- 

If S \= ^X/ then S U {i|)|^J kp. ~'X/ and because x G NewCons['[\>^a,S), we have 
X l=gpL ^X/ a contradiction. Hence 5 U {x} ^p^ -L- 

Suppose now that there is a literal ^ G x such that -■£ ^ {-'^i : £i G x and a 9^ £i}. 
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Then, the prepositional valuation in which Xi^tme satisfies 

<S U (x) U {-«! : £i G X and fl 7^ £i}, 

and then 

5U{x}U{-£t : £tGxandfl9^£t}^pL±. 

Hence there cannot be such a literal, and then for all ^i € X/ « ?^ ^i- 

Now, from fl 7^ ^i for all ^i € X/ we have |= Ai^^t ^ ^1 ^ X arid a -/> £1} <-> -'X- 
From this and the hypothesis 

5U{(p,(p^JU{-£t : £iGxandfl9^M^pL± 
it follows 5 U {cp , (p^ , -x) ^p|_ -L- ■ 

Proof of Theorem 7.3 

We are about to prove that V" satisfies Postulate PS if and only if Sjmp* = 0. 

(=>): Suppose Sjmp* ^ 0. Then at the first step of the algorithm there has been 
some cp — > (fl)T G X" and some & C C such that for some x G Nez<7Cons(i|)^„,iS), 
V h -((P A (p^„ A-x) and (£cpl, ^pL,'5) ^ -((p A cp^, A-x)- Hence P" does not 
satisfy Postulate PS. 

(<=): Suppose that Sjmp* = 0. Therefore for all cp' — > (fl)T G A"" and for all subsets 
&" C C, we have that 



forallx G Nezi;Cons(i|;^„,>S),if 5 U{(p',(p^„,-X} ^p, -L, ,^,, 

(CI) 

then there exists ^i G x such that fl -^ £1 



From (C.l) and Lemma C.6, we get 

for allx G Nea^Cons(\|)^„,5), if iS U{(p, (p^„}U{-'£i : £1 G x and a 7<^ £1} ^p|_ ±, 
then 5 U {x} U {-£t : £t G X and a 9^ £J ^pL ^ 
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From this and Lemma C.5, it follows that 

ior all x^ NeioCons{-[\)^„, S),ii S U{(p',<P((},}Llindep'^ ^pi_ ±, 
then5U{x}Umdep;;^PL ± 

This and Lemma C.4 gives us 

if 5 U {(p ', (Pfjh] U indep'^ ^p^ ±, then S U NewCons{-[\)^„ , 5) U fndep^ ^p|_ ± 

From this and Lemma C.l, it follows that for all indep^ C indep^, for every cp ' — > (fl)T € 
X" and all & C C, 

if 5 U {cp', cp^J U indep'^ ^p^ ±, then S U {i|)^„} U indep'^ ^p^ ±. (C.2) 

Now, suppose {jCcpL,yp.,S) ^ cp for some propositional cp. We will build a 
model ^ such that .^ is a model for D" that does not satisfy cp. 

Let ^ = (W,_R(,) be such that W = valuations [S), and Ra be such that for all 
w,w' E W, wRaw' if and only if 

• 1= ,i|)t for every cpt — > [fl]i|)i € C such that |= cpt; and 

• H^-£ for all £ such that a o^ £ and ^-£. 

w' "W 

We have that ^ is a '^-model, by the definition of Ra- By the definition of W, ^ is a 
model of S. We have that ^ is a model of £" and X", too: for every cp^ — > [a]'^i E C 
and every world w G W, if ^ cp;, then, by the definition of Rg, \= ibi for all w' E W 
such that w_R(,w'. Moreover, ^ is also a model of X": for every (pi — > (fl)T G A'" and 
every world w G W, if ^ cpt, then 

£:''(w) = {(Pi ^ [fl]ii)t G ^^ : ^(pj, and indep^[w) ={^i ■ ai^i and ^-£} 

are such that S U {cpi, ipf»(w)} U indep^{w) \^p^ ±, where 
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From this and (C.2), we have S U {ij^fn(w)} U indepjw) ^ ±, where 

As Wis maximal, there exists w' such that |= ,'^s''{w) /\indep^(w). As Ra is maximal by 
definition, we have wRaw'. Hence there exists at least one w' such that wRaw', and 

Hence, ,^ is a model of V^. Clearly ^ cp, by the definition of W. Hence P" ^ (p. 
Therefore V satisfies Postulate PS. ■ 

Proof of Theorem 7.5 

Let If^^ be the output of Algorithm 7.2 on input V = (£pdl, [^,SuS''UX"U T). IfV" 
satisfies Postulate PS, then V satisfies Postulate PI if and only iflff^p = 0- 

Let T>" = (£pDLi \=^,S U £" U X" U 1") be an action theory for action a. For every 
t" C £" we define: 

Moreover, let mdep^ = {^£ : «-/>£}. 

Lemma C.7 

If S,!" ^^^ ((p^„ A indep'j — > [fl]± and 5 U {tJj^J U mdep^ |=p|_ ±, then there is x G 
NewCons[-^\)^„,S) such thatS,!"^ ^p|_ ((p^„ A^x) -^ W-L anda 7^ £1 foralHi G x- 

Proof: 

Let 5, J" ^p|_ ((p^, Aindep'j -^ [a]±. Then there is a PDL-model ^ = {W,Ra) such 
that \= S AI" and ^ ((p^„ A indep'j — > [fl]±. This means that there is a possible world 
V G W such that ^ cp^ A mdep^ and ^ [a]±. From |= (p^„ A indep'^, it follows 

5u{(p^JUmdep;^PL± (C.3) 

From hypothesis S U {ij)^„} U indep'^ \= ± and Lemma C.l, we get 

S L) NewCons[-<\> ^„ , S) U indep'^ |=gp|_ ± 
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and from this and Lemma C.2 we have that there is x G NewCons{'[\>^a,S) such that 

<S U (x) U indep'^ ^pL ± (C.4) 

From (C.3), (C.4) and classical logic, there is x G NewCons[-i\>^a,S) such that 

S U {cp^J U indep'^ \^p^ ± and 5 U (x) U indep'^ \=p^ ± 
From this and Lemma C.5 it follows that there is x G NewCons(-i\>^a,S) such that 
5U{(p,(p^JU{-£i : £i G x and fl -/> £i} ^pL ± 

and 

5U{x}U{-£i : £t G X and fl -/> £t} ^pL ± 

This and Lemma C.6 gives us that for all ^i G X/ « ?^ ^i- 

Now, because .^ above is such that |= (p^„ A indep'^, from this and 5 U (x) U 
indep'^ \=^p^ ±, we have that |= (p^„ A ^x- Because ^ [a]±, we therefore have 

Proof of Theorem 7.5 

We are about to prove that if V satisfies Postulate PS, then T>" satisfies Postulate PI 
ifandonlyifXf^p = 0. 

(=>): Straightforward, as every time D" |= <P — > M-L/ we have (£pDL) l^pni ''^ ^ "^"^ ^ 
(p — > [a] ±, and then I" never changes. 

(<=): Suppose that If = 0. Therefore for all subsets c" C S^, we have that 



forallx G NewCons[-i\)^,S), ii S ,T \^^^ (cp^, A-'x) -> M-L, 
then there exists ^i G x such that fl -^ ^t 

From (C.5) and Lemma C.7, it follows that for all c" C £", 

as,!" ^p|_ ((p^Aindep'j -^ [a]±, 
then 5 U {\|)^„} U fndep^ ^p|_ ±. 



(C.5) 



(C.6) 



Suppose {CpDL, l=pDL''^ ^ -^"^ b^ 'P ~^ W-L for some cp G S^ml. Then there exists a 
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PDL-model .^ = (W,_R«) such that F 5 A J" and F <P ^ W-L- This means that there 
is a possible world v G W such that |= cp and F [^l-L- 

(We are going to build a model of V, and hence conclude that 2?" ^ cp — > [fl]±.) 

For given w ^W, we define: 

X«(w)={cp,^[fl]±GX'' :^(pj 

Because D" satisfies Postulate PS, we can extend ^ to a big model .^' = {W' ,R'^) 
such that W = valuations{S) , and R'^ is defined such that for all w,w' G W', wT^^w' if 
and only if 






^ , ^t for all £ such that a 7^ £ and H= ^£; 

• 1= , ij'i for every cpt — > [a]'^i G .S" such that |= cpi; and 

• J^lw) = 0. 

By definition, M' is a '^-model. We also have |= S , by the definition of W'. ^' is 
a model of (5^", too: for every cpt — > {d\-^\ G if^" and every w G W', if |= cp^, then 
\= , i|)i for all w' G W' such that ^wR'^^^w' . Clearly M' is also a model of X": for every 
(Pi ^ [fl]± G X" and every w G W', if ^' cpt, then X^lw) ^ and K^(w) = 0. .^' is a 
model of <%"", too: for every cpt — > (fl)T G ^'' and every w G W', if |= (pt, then 

f^lw) = {cpt ^ [fl]^t G <?" : ^cpi}, and indep^iw) = F« : « -/> ^ and ^-£} 
are such that 5 , X" ^p|_ [(pga^y^-^AindepJyw)) — > [fl]±, where 

The justification is that iSjX" |= (<P£:»(w) /\ indep^{w)) — > [fl]± would imply V \= 
((P£n(w) A indepg(w)) -> [fl]±, and as long as cpi -> (fl)T G X", V" \= -'(cpi A (p£»(w) A 
indep^iw)). Asby hypothesis P" satisfies PS,^((piA(pfn(^)AOTdep^(w)) G 5, and then 
w ^ W'. 

Hence, from S,I'^ ^^^_ {V£"(w) ^ indep^{w)) — > [a]± and (C.6), it follows that 
S U {i|)£:»(w)} U indep^iw) \^p^ ±, where 

'^£"(w) = /\b\>i ■ <Pi -^ [a]^\>i G <£:''(w)} 

As W' is maximal, there exists w' such that |= , ij^fn(w) ^ indep^(w). As i?^ is maximal 
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by definition, we have wR^w'. Hence there exists at least one w' such that wR^w', and 

then^'(fl)T. 

-w' 

Therefore, ^' is a model of V". 

Looking at V G W', we must have 5, X" ^ {(pgaf^^ Aindep^(v]) — > [fl]±, because 
otherwise Ra{v) = 0, against the hypothesis that ^ [a]±. Hence, from (C.6) it follows 
that5U{i|j£fl(v)}UOTdep^(v) \^p^ _L, and then there exists at least one v ' such that vR^v ', 
and then 1= (a)T. From this it follows that P" b^ cp — > [fl]_L. Therefore P" satisfies 
Postulate PI. ■ 



Appendix D 



Long Proofs of Chapter 8 



Proof of Theorem 8.3 

Let V = (£pDL) [^,S yj £ yj X yjl) satisfy Postulate PS*. V satisfies Postulate PI* if and 
only ifV = (£pdl, ki,,S U £" U X" UI") satisfies Postulate PI for all a £ 2lct. 

(=>): Suppose that P" |= <P — > [a]±, i.e., SyS^yX",!" [^ cp — > [a]±. By monotonicity, 
S,£,X,I [^ (p — > [fl]±, too. Now suppose that (£pDL) hpDL) 5 U J") ^ cp — > [fl]±, i.e., 
S,!" ^ cp — > [a]±. Then there exists a possible worlds model ^ = {W,Ra) such 
that \= S AI" and there is a possible world v G W such that |= (p and \^ [a]-L. Let 
^' = {W',R') be such that W = W, and R',, = 0, for all «' ^ a, and K^ = Ra. Then 
1= S AI, and then 5,X ^^^^^ cp — > [fl]±. Hence D does not satisfy PI*. 

(<=): Suppose that V does not satisfy Postulate PI*. Then there exists cp G iJmt such 
thatPh cp^ [fl]±and(£pDL,^DL"^^^)^^^ [«]^- 
Claim: P" h cp ^ M-L. 

(Proof of the claim): Suppose P« \^ V ^ [a]±, i.e., S,£\X\I'' ^ cp ^ M-L. Then 
there exists a -^-model .^ = {W, Ra) such that \^S A ^^ A A"" A J" and ^ cp ^ [a]±. 
This means that there is a possible world v G W such that ^ cp and ^ [fl]-L, i.e., there 
isv' E W such that i?fl(v) =v'. 

(We extend ^ to all other actions V speaks of and obtain a model of V.) 

Given w €^ W, for each a^ E 2lct we define: 

j%(w)={(pj^N±GX''^ :^cp} 

;t"'t(w)={(pj^(fl,)TG^''^ :^(p^} 

Let ^' = {W',R') he such that W = W, and R' = i?« u U'^^a'/ where for each 
a' y^ a and every w,w' € W', wi?(,/w' if and only if 
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• W ^i for all i such that «' 9^ £ and F ^^. 

• 1= , ij^i for every cpt — > [fl']i|)i G f^" such that \= cpi; and 

. J'''(w)=0; 

By definition, ^' is a model of the dependence relation '^. Because, by hypothesis, V 
satisfies PS*, there is no implicit static law, i.e., for every a^ € 2lct and every w € W', 
if J''^(w) 7^ 0, then A"'^(w) = 0. Then, as W = valuations [S), Ji' is a model of S. 
We have that ^' is a model of E, too: it is a model of f , and given a' ^ a, for every 
cpi — > [fl']i|)i € £■ and every w G W', if |= cpt, then |= , i|)t for all w' G W' such that 
wi?(,/w'. Clearly ^' is also a model of X: it is a model of X", and given a' 7^ a, for every 
cpi^ [fl']± G Zand every w G W, if H^'cpi/ thenZ^'lw) ^0 and i?a/(w) =0. ^'isa 
model of ^, too: besides being a model of X'^, for every a' ^ a and all worlds w G W' 
such that X'^ (w) 7^ there is a world accessible by K^' , because -R(j'(w) = in this 
case would preclude A*" (w) 7^ 0, and otherwise w ^ W', which is impossible as long 
as PS* is satisfied. Thus^ <SA£^A^AJ, butif thisisthecase, 5,f ,-Y, J ^ cp — > [fl]±, 
hence we must have 5, f , ^"iX" [^ cp — > [fl]_L, and then 2?" |= <P — > M-L- (End of the 
proof of the claim.) 

From(/:pDL,^DL''^U^) ^ 'P ^ [a]± it follows (/:pDL,^DL''^U^'') ^ 'P^ [«]^- 
Putting all the results together, we have that P" does not satisfy Postulate PI. ■ 

Proof of Theorem 8.5 

lfV = (£pDLi ^,S\J£\^ X \JX) satisfies Postulate PS*, then P |= tp — > [a]'^ if and only 
if{CpDL,h.,S[j£'ur)y^)^ [a]^\>. 

(^): Let V = (£pDL, t^.^SU.JuA'UJ) satisfy Postulate PS*, and also suppose that 
{CpDL,k^,Su£"Ul'') ^ (p ^ [a]^\>,i■e.,S,£\I" ^ cp ^ [a]\\). Then there exists a 
^-model ^ = {W,Ra), such that \^S AS" AI" and ^cp ^ [a]^\). This means that 
there is a possible world v & W such that ^ cp and F W^l^/ i-^v there is v' G W such 
thatK«(v] =v'and^ii). 

(We will extend ^ to obtain a model of V and thus show that D ^ cp — > [fl]i|).) 

Given w G W, for each At G 2lct we define: 

j«i(w)={(pj^ [flJ^GX"^ :H^(Pj} 

A"'^(w)={(pi^(fl,)TGA"'^ :^cpj} 
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Let J{' = (W',K') be such that W = W, and R' = R,\J [j„,^Ra', where for each 
a' ^ a and every w,w' G W', wRa'w' if and only if 

• ^'^l for all I such that a' -/> £ and ^'-t 

• 1= , M^i for every cpt — > [fl']i|)i G .S" such that |= cpi; and 

• X^'lw) =0; 

By definition, ^' is a model of the dependence relation ^^. Because, by hypothesis, V 
satisfies PS*, there is no implicit static law, i.e., for every At G 2lct and every w G W', 
if 2:''t(w) 7^ 0, then ;t"'t(w) = 0. Then, as W = valuations{S] , J^' is a model of 5. 
We have that .^' is a model of S, too: it is a model of 6'^, and given a' ^ a, for every 
<Pi — > [fl']ij^i G <? and every w G W', if ^ cpi, then |= , i|)i for all w' G W' such that 
wRq'w'. Clearly ^' is also a model of X: besides being a model of I", given a' ^ a, 
for every cpt — > [a']l. G Zand every w G W', if ^ cpi, then 2""' (w) 7^ andR(,/(w) = 0. 
.^' is a model of X , too: it is a model of A"*, and for every a' ^ a and all worlds 
w G W such that ^'' (w) 7^ there is a world accessible by Ra' , because Ra' (w) = in 
this case would preclude X'^ (w) ^ 0, and otherwise w ^ W', which is impossible as 
long as PS* is satisfied. Thus \= S A£ AX AX. Because there are v, v' G W such that 
1= (p, vRflV' and ^ i|), we have iS,f ,^,X ^ cp — > [fl]ij), and then D ^ cp — > [fl]\|;. 

(<=): Suppose P ^ cp — > [fl]i|), i.e., iS,f ,^,X ^ cp — > [fl]i|). Then there is a '^- 
model ^ such that |= S AE A X AX and ^ cp — > [fl]i|). Then, given a, we have 
^S A ^^ A ;t"' A J^ and then ^ S AS" AX". Hence 5 , £:^ X" ^ cp ^ [fl]^), and then 

(/:pDL,b.'5u^''ux'')^(p^ [fl]^. ■ 

Proof of Theorem 8.6 

IfV = (£pDL, [^,S U £ yj X yjX) satisfies Postulate PS*, then 2? |= <P — > («)T if and only 

ff(£pDL,^DL''5U-Y'')h(p^(fl)T. 

(^): Let P = (£pDL,b.,5 U .5: U -Y U X) satisfy Postulate PS*, and suppose that 
(-CpDL) l=p[3|_)'5 U <¥") ^ cp — > (fl)T, Le., 5,^"" \g^^^ cp — > (fl)T. Then there exists a 
PDL-model ^ = {W,Ra), such that ^ 5 A ;t"' and ^ cp -^ {a)T. This means that 
there is a possible world v G W such that |= cp and ^ (fl)T. 

(We extend ^ to build a model of P and then conclude that D ^ cp — > (fl)T.) 

Given w G W, for each a^ G 2lct we define: 
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Let .^' = {W',R') be such that W = W, and K' = K^ U Ua'^^a'' where for each 
i' ^ a and every w,w' G W', wK^/w' if and only if 



^'-£ for all £ such that a' 7^ £ and H^'-£; 



• 1= , ij^i for every (p^ — > [«']ij^i G <?" such that |= cpi; and 

• J^'lw) = 0. 

By definition, ^' is a model of the dependence relation ^^. Because, by hypothesis, V 
satisfies PS*, there is no implicit static law, i.e., for every Ui € 2lct and every w € W', 
if X"'[w) ^ 0, then I^'iw) = 0. Then, as W = valuations[S) , J^' is a model of S. 
We have that ^' is a model of E, too: it is a model of f , and given a' ^ a, for every 
cpi — > [fl']i|)i € <5 and every w G W', if |= cpt, then |= , i|)t for all w' G W' such that 
wi?(,/w'. Clearly ^' is also a model of X: it is a model of X", and given a' ^ a, for 
every cpt — > [fl']± G X and every w G W, if ^ cpt, thenX'''(w) ^ and -R(j'(w] = 0. 
^' is a model of X , too: besides being a model of X", for every a' ^ a and all worlds 
w G W' such that A*" (w) 7^ there is a world accessible by K^', because Ra' (w) = in 
this case would preclude X" (w) 7^ 0, and otherwise w ^ W', which is impossible as 
long as PS* is satisfied. Hence |= S AS AX AT. Because there is v G W' such that 



^ (pandit (fl)T, we have 5,<5, A',X ^ (p — > (fl)T, and then D ^ (p — > (fl)T. 

(<=): Suppose P ^ cp — > (fl)T, i.e., iS,(f,A',X ^ cp — > (fl)T. Then there is a '^- 
model .^ such that |= S A S A X AX and ^ cp — > (fl)T. Then, given a, we have 
^5 A f " A A"" AX", and then H^5 A ^^ Moreover, by definition, ^ is a PDL-model. 
Hence 5, A""^^^ cp ^ (fl)T, and then (£pdl, ^dl'*^ ^ '^'') ^ ^ ^ <«)T- " 

Proof of Theorem 8.8 

lfV = (£pDL) [^,S yj £ yj X yjT) satisfies Postulate PS*, then D |= <P — > [«i;- • -laTiliI^ if 
and only if {£pDL,k^,S U £""■■■ '"^ Uj^i ,...,«n^ h (p ^ [ai; . . .;fl^]\|;. 

Lemma D.l 

7/ D h <P — > [«i; • • •;«tJi|^/ then there is cp' G 5^ml such thatV |= <P — > [«i; • • ■',an-^]<p' 
andV 1= <p' — > [flTi,]i|'- 
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Proof: 

Let V \= (p — > [fli; . . . ;an]ijj. H T> \= (p — > [ay,...;an]-i-, the result immediately fol- 
lows. Then, given a model .^ = {W,R) of V such that |= cp for some w G W, if 
\= {ay,. . . ;fln)T, there must be at least one w^_^ such that |= , [un]'^- Take all such 

n— 1 

w^_^ and let cp ' be 



V 



Wn-1 



"n-l 



Then we have P |= <P — > [«i; • • • ;fln-i]<p'/ and D |= "p' — > [«n]i]^- ■ 

Proof of Theorem 8.8 

(^): The proof is by induction on the number of action operators. 

Base: n = 1 . As V satisfies Postulate PS*, the result follows from Theorem 8.5. 

Induction hypothesis: for any k < n, if P |= cp — > [fli ; • • • ; «k]ij^/ then (£pdl > i^ > '^ U 
£•«!,. ..,flk ux«i.-.«k) ^ (p ^ [fli;...;flk]il). 

Step: let P h <P — > [ar,. . .;fln,]ij^- By Lemma D.l, there is a classical formula cp' 
such that P 1= cp — > [fli; . . .-jflTT^-ilcp' and P |= cp' — > [flnlij^- From the induction hy- 
pothesis, we have that (£pdl, b*, 5 U £:"' •-'"--' uX"' •■■■'"--') h cp ^ [fli;...;fl^_i]cp' 
and (rpDL.b^.^U^"" UX"") h cp' ^ [flnl^l^- This gives us (£pdl, bt,''^ U f"' -•'"" U 
X«,,...,«n)^ cp^ [fli;...;fln]^. 

(<=): Suppose X> ^ cp — > [at, • • •;fln,]ij^/ i-e., S,E,X ,zy^ cp — > [at, . . . jflnlij^- Then there 
is a ^^-model .^^ such that |= S f\E f\X /\X and ^ cp — > [at, • • • ;«n,]i|'- Then, given 
fli,...,fl^, wehave H^5 A^:"! -••"" A A'"! •■■■•"- A J"! •■■■•"-, and then H^5 A £:"! --"- A 
Xfl,,...,fln, Hence 5,f'"--''-,X'" •■■-"- ^ cp ^ [at,. • .;fln]i|^, and then (£pdl, bt.-'^ U 
£•«!,. ..,fl„ LJX"' •■■-"-) ^ cp ^ [Ai;...;fln]M>- ■ 

Proof of Theorem 8.9 

IjV = (£pDL) t^,5U(?UA'UX) satisfies Postulate PS*, f/zen D |= cp — > (ai; . . .;An,)i|> ?/ 
AndonZi//f(£pDL,i^,'5U<5:''i--''" uA""--"- uX"! •■■■•"-) h cp ^ (at,. . .;a^)i|;. 

Lemma D.2 

LetV = {CpDL,h^,S U S U X UI) satisfy Postulate PS*. If D h cp ^ (a)i|) is the case, 
then (£pDL,h ,S US" U X" Ul") ^ ip ^ {a)^\). 
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Proof: 

Let V satisfy Postulate PS* and suppose (£pdl, h^,^ U S" U X" U I") \^ (p ^ {a)^\>, 
i.e.,S,£\X\T ^ cp ^ (fl)i|). Then there exists a ^-model ^ = (W,]?^), such that 
1= S AS" AX" AX" and ^ cp — > (fl)i|). This means that there is a possible world v E W 
such that h cp and ^ (fl)i|). 

(We extend ^ to build a model of V and then conclude that D ^ cp — > (fl)i|).) 

Given w G W, for each a^ € 2lct we define: 

j%(w)={(pj^[flJ±GJ''^ :^(p} 

X"^{^v)=[<p^^{a,)J(^X"^ :^cpj} 

Let ^' = (W, R') be such that W = W, and R' = /?„ U U^'^ K«' (we extend .£ to 
all other actions V speaks of), where for each a' ^ a and every w,w' € W, wRa'w' if 
and only if 

• ^'^i for all i such that a' nU i and ^'-£; 

• 1= , ij^i for every cpi — > [fl']i|)i G (5^" such that 1^^ cpt; and 

• T\w] = 0. 

By definition, .y#' is a model of the dependence relation ^^. Because, by hypothesis, V 
satisfies PS*, there is no implicit static law, i.e., for every Ui € 2lct and every w € W', 
if X"'[w) ^ 0, then T''^(w) = 0. Then, as W = valuations[S] , Ji' is a model of S. 
We have that .y^' is a model of E , too: it is a model of E'^ , and given a' ^ a, for every 
cpi — > [fl']i|)i € £^ and every w G W', if |= cpt, then |= , Tj^t for all w' G W' such that 
wRaiyv' . Clearly .y^' is also a model of X: it is a model of X", and given a' ^ a, for 
every cpt — > [fl']± G X and every w E W', if ^ cpt, thenX'''(w) ^ and -R(j'(w) = 0. 
^' is a model of X , too: besides being a model of X", for every a' ^ a and all worlds 
w G W' such that -Y" (w) ^ there is a world accessible by Ra' i because Ra' (w) = in 
this case would preclude X'^ (w) ^ 0, and otherwise w ^ W', which is impossible as 
long as PS* is satisfied. Hence |= S AE AX AX. Because there is v G W' such that 
1= (p and 1^ (fl)\|), we have 5,£^, A',X ^ (p — > (fl)ij;, and thenD ^ (p — > (fl)T. ■ 

Lemma D.3 

IfV \= cp — > (fli; • • • \oini^, then there is cp' G S'ml such thatV |= <P — > (fli; • • • ;fln,-i)'P' 
andV 1= <p' — > (fln)il'- 
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Proof: 

The proof is by induction on the number of action operators. 

Base: n = 2. Suppose P |= ^ — > (fli;«2)ij^- Then D |= <P — > (fli)(«2)ij^- For every model 
J{ = {W,R) of V and for every w £ W such that |= cp, there is w' E W such that 
w_Rfl, w' and ^ , {az}'^- Let cp ' be /\{£ : £ G w'} and the result follows. 

Induction hypothesis: for any k < n, if P |= cp — > (ar, • • • ;«ic)i|^/ then there is cp' € 5^ml 
such that P h <P — > («i; • • • ;«k-i)^' and P |= v' — > («ic)'>l^- 

Step: let P h <P — > («i;- • •;«ti,)iJ^- Then P |= ^P — > («i; • • • ;«ti,-i)T. By the induction 
hypothesis, there is cp' € S'trit such that P |= cp — > (fli; . . .;flri-2)'p' and P |= ^' — > 
(flri-i)T. Because P |= <P — > («i; • • • ;«ti,)i|^/ given a model .^ = {W,R) of P such that 
1= cp for some w e W, there must be w^_2 € W such that ^ , (fln-i ) («n)i|^- Then we 

n — 2 

can safely take cp ' as /\{£ : £ G w(^_2}. Now, P |= <P ' — > («n-i ) («n,)i|^- By the base step, 
there is cp " G 5'mt such that P |= ^P ' — > («n,-i ) <P " and P |= ^ " — > («n,)i|^ • Putting all the 
results together, we get P |= cp — > (fli; . . . ;flTi-i)'P" and P |= "P" — > («n)ij^/ for some 
(p"G5^m[. ■ 

Proof of Theorem 8.9 

(^): The proof is by induction on the number of action operators. 

Base: n = 1 . As P satisfies Postulate PS*, the result follows from Lemma D.2. 

Induction hypothesis: for any k < n, if P |= cp — > (fli; . . . ;flic)i|), then {CpQi,\^,S U 

gay,...,a^ yj p^a, ,...,a^ yjfl,,...,^^) ^ (p ^ (flT, • • • ;flk)l|>- 

Step: let P |= cp — > (fli; . . . \ar^^. By Lemma D.3, there is cp' G 5'm[ such that P |= 
(p — > (fli; . . .;flTT,-i)'P' and P |= <p' — > («n)i|^- By the induction hypothesis, we have 

(/:pDL,b,'SU 5"' •■■■'"—' uA-"!--"— 1 uZ"!--"— 1) h cp ^ (fll;...;fl^^_l)(p' and also 
(^PDL,h^,'S U-f:"'^ U^"-^ UX"-) h (p' ^ (fl^)i|). Then, this gives us (£p 01,^^,5 U 

(<=): Suppose P ^ cp — > (fli; . . . ;flTT,)i|^/ i-e., (S,£^,^,X ^ cp — > (fli; . . . ;flTT,)i|). Then 
there is a ^^-model .^ such that \= S A £ A X AT and ^ cp — > (fli; • • • ;«ti,)iJ^- 
Then, given Hi, . . . ^a^, we have H^ 5 A <?"! '-•"" A X""' •-•"- A X"' •-•"-, and hence 
5,f'"--''-,A""--''-,X'" •■■■•"- ^ (p ^ (fli;...;fln)i|>- Then (£pDL,h^,<S Uf""-'"" U 
A""--"" uX"' •■■-"-) ^ cp ^ (fli;...;fl^)il). ■ 
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Appendix E 



Long Proofs of Chapter 9 



Proof of Theorem 9.1 

Let O be a formula that has the form of one of the three laws. For all models M' , if .^' G M'^ 
for some ./M = (W, R) such that |= V, then |= V'. 

Let ./^ be such that |^ V and let .^' G ^^. We analyze each case. 

Suppose O is (p, for some propositional cp G ^ml. Then ^' = {W',R), where 
W' = WQvaluations((p) . Because we have assumed the syntactical classical contraction 
operator 9 is sound and complete w.r.t. its semantics, .^' is a model of S~. As '^ and 
£ have not changed, clearly ^' remains a ^^-model and a model oi £. .^' is also a 
model of X~: for every w G W' and every (cp^ A cp) — > (fl)T G <%"", |= cpt A cp implies 
R,(w) y^ 0, because ^cpt ^ (fl)T. Hence \^' S' AS AX', and then H^'p" 

Let now O have the form cp — > [fl]ij), for (p,ij> G 5^ml. Then ^' = {W,R U i?^) such 
that Rg C {(w,w') : ^ cp}. It is enough to show that ^' is a model of £~ and of 
the new dependence relation ^^'. Clearly it is a model of ^^', since it is a '^^-model 
and ^^C^^'. Now, for all w G W and every (cp^ A ^cp) — > [fl]i|)i G £~, if ^ "Pi A -■cp, 
then 1= (pi, from what it follows ^ cpi, and because |= f , |= ,i|^i for all w' G Raiw)- 
Moreover, as \a tP/ we have ^ cp, and then R'^iw) = 0. Putting both results together, 
it follows 1= , i|)i for all w' G Raiw), and then |= £~. Hence |= 'D~^ r , , . 

Now let O be of the form cp -> {a)T, for some cp G dmi Then ^' = (W,i? \ K^), 
such that K^ C {{w,w') : wRaw' and |= cp}. It suffices to show that ^' is a model 
of A:"". For allw G Wand every ((pt A^cp) — > (fl)T G <%"", if h cpi A-'cp, then |= cpt, 
from what it follows |= cpi, and because |= X, there exists w' G W such that wRgw'. 
Because ^ cp, ^ cp, and then Rgiw) = 0. Putting both results together, it follows 
1= (fl)T, and thus h ^~. Hence ^ '^Z->(a)T- " 
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Proof of Lemma 9.2 

Let V = (£pDL) [^,S yj £ yj X) he modular, and let O be a formula of the form of one of the 
three laws. Then V~^ is modular. 

We analyze each case. 

Let O be cp, for some propositional (p G ^vai, and suppose I'" is not modular. Then 
there exists cp' G g^mt such that X>~ |= cp' and (£cpL) I^pl'*^") "^ ^' > i-^-' S~,£,X~ [^ 
cp' and iS~ ^ cp'. As the original X has been weakened and the syntactical proposi- 
tional contraction operator © has been assumed to satisfy Katsuno and Mendelzon's 
postulate Cn (5 9 (p) C Cn (5), we must have 5, £^,^ [^ cp'. Because P is modu- 
lar, it holds 5 1= cp'. Then we have at least c'fl/uflh'onsl^cp') C valuations (^ cp ), ior 
S~ \^Pi (p'. This means iS,£^,^ [^ cp — > cp', and then 9 has not worked as expected. 

Let now O have the form cp — > [fl]i|), for (p,i|j G 5^m[, and suppose T^~^ui^ is not 
modular. Then there exists cp ' G g'm( such that D~^ri. |= cp'and (/^cpL) hpp, ii^) ^ cp', 
i.e., <S,£:~,^ t^, (p'and5 ^p|_ cp'. 

Claim: If <?,£:-,;f t^, cp', then<S,£:-, -Y ^ cp'. 

(Proof of the claim): Straightforward: suppose 5, f~,A' ^ cp'. Then there exists a 
possible worlds model ^ = (W, R) such that .^^ is a '^-model, |= 5 A <?~ A X, and 
^ cp'. Because -^C^^', ^ is a ^^ '-model, too. Hence, S,S~,X ^, cp'. (End of the 
proof of the claim.) 

Claim: 5, f, A" ^^ >SA£:-A^. 

(Proof of the claim): We show that there is no ^^-model ^ such that |= S A£^ A^ and 
\fs A f- A ;f . Let .^ = ( W, R) he a -^-model such that \fs A f" A ;f . Then there 
exists w G W such that y= S A £~ AX . li\^ Sorl^ X , the result follows. Consider 
W E~ . Then, there is some c~ C E~ such that 

€ A (^p^A^cp) 

and there exists w ' G W such that -wRa^ ' and 

A ^i 
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Then 

€ A *> 

Taking the obvious corresponding c '^ £, we get 



€ A <p. -d C A ,-!., 



Hence, t^ £, and then bt 5 A £" A A'. (End of the proof of the claim.) 

VromSySyX [^ S /\£~ /\X ,andS ,£~ ^X [^ cp ', it follows 5 , <£^ , A:" [^ cp'. Because 
S Wp, cp', I' is not modular. 

Now suppose (I) has the form cp — > (fl)T, for some cp G g^mt, and suppose T^Z^^/^^t 
is not modular. Then there exists cp' G g^ml such that we have T>~^,.^ |= cp' and 

cp ? ^^M^ 

(-CcPL,^PL,5)^cp',i.e.,5,^,A'-h^ (p'and^^p^cp'. 
Claim:5,<5:,;f [^S A£ AX'. 

(Proof of the claim): We show that there is no ^^-model ^ such that |= S A£ AX and 

^S A8 AX-. Let .^ = ( W, R) be a -^-model such that \j^ S A £: A ^-. Then there 



andKJwl =0. Then 



exists w G W such that tt 5A(5^AA' .Ifb^ 5or|^ £, the result follows. Consider 
A:"". Then, there is some X~ C X~ such that 

{cptA-cp)^(fl)T6A^- 

C A ^^ 

((PtA-cp)^((j)TeA^- 

Taking the obvious corresponding X C X, we get 

€ A <p. 

cpi— >(fl)T6-$ 



Because R<, (w) = 0, F -^^ and then F ^ A f A A". (End of the proof of the claim.) 

FromiS,f ,^ \^ iSA^^AA*", and iS,£^, A*" \^ cp ', it follows 5 , f , ^ \^ cp'. Because 
S ^ cp', P is not modular. ■ 



1 70 ^ong Proofs of Chap ter 9 



Ceci n'est pas un resume 



I love French wine, like I love the French language. I have sampled every 

language, French is my favourite -fantastic - language, especially to curse 

with. Nom de Dieu de putain de bordel de merde de saloperie de connard 

d'encule de ta mere I You see, it's like wiping your ass with silk, I love it. 

— Merovingian, in Matrix Reloaded 



Pourquoi on est la ? 

Dans les approches de representation de connaissances basees sur la logique, la con- 
naissance concernant un domaine est habituellement decrite par des ensembles de for- 
mules logiques (theories). Dans le raisonnement sur les actions nous nous interessons 
a des theories qui decrivent le comportement d'actions sur des proprietes du monde. 
Nous appelons de telles theories theories d'action ou descriptions de domaine. 

D'habitude, une theorie d'actions est un ensemble d'enonces ayant la forme : " si 
contexte, alors effet apres chaque execution d'action " ; et " si pre-condition, alors action 
executable ". Le premier type d'enonce est utilise pour exprimer des lois d'effet, c'est- 
a-dire des formules qui relient une action a son resultat, etant donne un contexte par- 
ticulier. Le second type d'enonce represente des lois d'executabilite, qui etablissent les 
conditions suffisantes sous lesquelles une action est executable. Leur dual fournit les 
conditions necessaires pour qu'une action soit executable : " si pre-condition, alors ac- 
tion impossible " . Finalement, dans une representation d'un domaine dynamique, nous 
avons egalement des enonces qui ne mentionnent aucune action. Ceux-ci representent 
des lois sur la partie statique du monde, c'est-a-dire les contraintes qui determinent les 
etats possibles. Nous appelons ce type de contraintes les lois statiques du domaine. 

Lorsque Ton decrit des theories d'action, I'objectif est de doter un agent de la 
capacite a raisonner dans un domaine dynamique et d'agir de maniere rationnelle. 
Parmi les differents types de raisonnement qu'un agent pent avoir, nous identifions 
la verification de la consistance de sa theorie ; la prevision des effets des actions ; 
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Y explication de I'observation d'un effet donne ; I'elaboration d'un plan pour accom- 
plir un but ; la verification de V executabilite ou de Yinexecutabilite d'une action donnee ; 
et la revision et mise a jour de ses connaissances sur le comportement d'une action. 

A priori la consistance est le seul critere fourni par la logique formelle pour verifier 
la qualite des theories d'action. Dans ce travail, nous arguons que toutes les approches 
existantes dans la litterature sont tres liberales dans le sens ou nous pouvons avoir des 
theories d'action satisfiables qui sont intuitivement incorrectes. Done une notion au- 
dela de la consistance est necessaire pour evaluer des descriptions de domaine. 

Le modulaire c'est le bon 

La modularite est devenue un des mots d'ordre de nombreux domaines en informa- 
tique. C'est aussi le cas pour la representation de la connaissance et le raisonnement, 
ou des descriptions monolithiques se sont montrees d'utilisation tres complexes. 

Les dernieres annees ont vue la parution de plusieurs travaux qui, de maniere plus 
ou moins implicite, abordent des concepts tels que module, intelligibilite, evaluation, 
tolerance a I'elaboration, et d'autres. La plupart de ces termes sont empruntes de 
I'ingenierie de logiciel, parfois sans une notion claire des impacts qu'ils peuvent avoir 
quand ils sont transposes dans des domaines ou leur emploie n'est pas une question 
d'intuition, mais ils doivent plutot s'accommoder avec des cadres formels bien etablis. 
Dans ce travail nous montrons que ce n'est pas une tache simple, en particulier lorsque 
la logique constitue le cadre formel dans lequel la connaissance est representee. 

Ainsi, la question qui emerge naturellement est " comment pouvons-nous faciliter 
la tache de I'ingenieur de connaissances pour decrire un domaine " ? Une reponse, 
en suivant evidemment la tendance diviser-et-conquerir, est la " modularisation de la 
theorie d'action ". Par contre, de meme qu'en programmation orientee objet, mod- 
ulariser une theorie d'action ne s'agit pas seulement de la decouper en plusieurs 
morceaux. Un tel decoupage doit etre fait de sorte a ce que la theorie resultante ait 
des proprietes interessantes. Dans cette these nous montrons que pour etre consideres 
comme de bons modules, ils doivent satisfaire certains desiderata. 



Quoi, dinde immortelle ?! 

Considerons un scenario ou nous avons une dinde et quelqu'un qui pent la mettre 
en marche ou bien lui tirer dessus avec un revolver. On pent formaliser ce scenario 
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a travers des formules logiques qui disent que " si la dinde est en marche, alors elle 
est vivante ", " si Tarme est chargee, alors apres tirer la dinde meurt ", " en attirant la 
dinde elle se mets a marcher ", " si la dinde est morte, alors I'attirer ne la ressuscite 
pas ", et " on peut toujours attirer la dinde ". 

Maintenant, du fait que " attirer la dinde la fait marcher " et " une dinde qui 
marche est vivante " on conclut " apres attirer la dinde, elle est vivante ". A partir 
de ga et de I'information " si la dinde est morte, alors I'attirer ne la ressuscite pas ", 
on deduit que " si la dinde est morte, alors apres I'attirer elle est a la fois vivante et 
morte ", c'est-a-dire une contradiction. Done il n'est pas possible d'attirer une dinde 
morte. De qa et etant donne que c'est toujours possible d'attirer la dinde, on deduit 
que la dinde n'est jamais morte, c'est-a-dire, elle est immortelle ! 

Cet exemple, aussi simple soit il, illustre bien un probleme important qui peut 
arriver dans des descriptions de domaine en raisonnement sur les actions : des in- 
teractions imprevues entre des formules. La presence de telles consequences sont un 
signe de que la theorie d'action n'a pas ete bien specifiee. Dans notre exemple, le 
probleme est dii au fait qu'on avait dit que c'etait toujours possible d'attirer la dinde, 
ou alors au fait qu'on n'a pas completement specifie le contexte oil Taction d'attirer la 
dinde la mets vraiment en marche. 

Dans ce travail nous enongons des postulats que toute theorie d'action doit sat- 
isfaire pour eviter que des situations comme celle ci-dessus se produisent. En plus, 
nous concevons aussi des algorithmes qui aident le concepteur du systeme a decider 
si une description de domaine satisfait I'ensemble de postulats et lui permettent de 
decouvrir quelle partie de la theorie doit etre modifiee pour la corriger. 

Au dela du cote intuition, nous montrons aussi que des theories modulaires dans 
notre sens possedent des proprietes computationelles interessantes. 

II faut bien pouvoir changer la theorie 

Supposons une situation ou un agent a toujours cru que si I'interrupteur est en haut, 
alors il y a de la lumiere dans la chambre. Supposons maintenant qu'un jour il observe 
que meme si I'interrupteur est dans la position superieure, la lumiere est eteinte. Dans 
un tel cas, I'agent doit changer sa theorie au sujet de la relation entre les propositions 
" I'interrupteur est en haut " et " il y a de la lumiere ". Cet exemple est une instance du 
probleme de changement des bases de croyance propositionnelles, et il est largement 
aborde dans la litterature sur la revision et la mise a jour de croyances. 

173 



Ensuite, supposons que notre agent croit que chaque fois que I'interrupteur est en 
bas, apres I'avoir bascule, il y a de la lumiere dans la chambre. Ceci signifie que si la 
lumiere est eteinte, dans chaque etat du monde qui suit I'execution de basculement 
de I'interrupteur, la chambre est eclairee. Puis, pendant une panne, I'agent bascule 
I'interrupteur et la chambre reste etonnamment dans I'obscurite. 

Pour completer les experiences de notre agent dans la decouverte du com- 
portement du monde, supposons qu'il a cru qu'il est toujours possible de basculer 
I'interrupteur, etant donnee la satisfaction de certaines conditions comme etre assez 
proche de lui, avoir une main libre, I'interrupteur n'est pas casse, etc. Cependant, un 
beau jour I'agent decouvre que quelqu'un a mis de la coUe sur I'interrupteur et, par 
consequent, il n'est plus possible de le basculer. 

Les derniers exemples illustrent des situations ou le changement de croyances sur 
le comportement de Taction de basculer I'interrupteur est obligatoire. Dans le pre- 
mier, basculer I'interrupteur, d'abord vu comme etant deterministe, doit maintenant 
etre vu comme etant non deterministe, ou de maniere alternative vu comme ayant des 
resultats differents dans un contexte specifique (par exemple, si la centrale electrique 
est surchargee). Dans le deuxieme exemple, I'executabilite de Taction consideree est 
remise en question a la lumiere d'une nouvelle information montrant un contexte in- 
connu qui empeche son execution. 

De tels cas de changement de theorie sont tres importants quand on manipule 
des descriptions logiques de domaines dynamiques : il peut toujours arriver qu'on 
decouvre qu'une action a en fait un comportement different de celui qu'on a toujours 
cru qu'elle avait. 

Jusqu'ici, le changement de theorie a ete etudie principalement pour les bases de 
connaissances dans les logiques classiques, en termes de revision et de mise a jour. 
Dans ce travail nous faisons done un pas vers le changement de lois d'actions et pro- 
posons un cadre qui traite la mise a jour des theories d'action. 

Or, qu'avons-nous fait ? 

Notre contribution est double : generale, car nous presentons des postulats qui 
s'appliquent a tout formalisme en raisonnement sur les actions ; et specifique, car 
nous proposons des algorithmes pour une solution existante au probleme du decor. 

Dans cette these nous avons identifie et fait une critique des approches principales 
de la modularite pour des descriptions de domaine, en precisant leurs caracteristiques 
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et en montrant pourquoi elles ne capturent pas completement la modularite dans le 
sens necessaire aux descriptions en raisonnement sur les actions. Nous avons argue 
que la modularite telle qu'utilisee usuellement en programmation ou definie dans 
les travaux sur la logique formelle n'est pas appropriee dans le raisonnement sur les 
actions. Dans le premier cas, ceci est en raison des restrictions d'expressivite. Dans le 
second cas, c'est parce que la modularite des theories logiques est habituellement trop 
forte et elle ne se montre pas tres utile si la theorie est une description d'un scenario 
dans le raisonnement sur les actions. 

Nous definissons done notre concept de modularite pour les theories d'action et 
mettons en evidence les problemes qui surgissent s'il n'est pas satisfait. En particulier, 
nous arguons que la partie non-dynamique des theories d'action pourrait influencer 
mais ne devrait pas etre influencee par la partie dynamique. 

Nous avons propose quelques postulats, et en particulier nous avons essaye de 
demontrer que lorsqu'il y a des lois implicites, alors on s'est plante en concevant la 
theorie d'action en question. Comme montre, une solution possible decoule de nos 
algorithmes, qui peuvent nous donner quelques directives lors de la correction d'une 
theorie d'action si necessaire. Au moyen d'exemples, nous avons vu qu'il y a plusieurs 
alternatives de correction, et choisir le bon module a modifier aussi bien que fournir 
I'information intuitive qui doit etre ajoutee est au concepteur du systeme. 

Dans ce travail, nous avons illustre par quelques exemples ce que nous pouvons 
faire pour rendre une theorie intuitive. Ceci implique la modification de la theorie. 
Nous avons presente une methode generale pour changer une description de do- 
maine, etant donnee une formule que nous voulons contracted 

Nous definissons done une semantique pour la contraction de theories et 
presentons egalement sa contrepartie syntaxique a travers des operateurs de contrac- 
tion. L'adequation et la completude de tels operateurs par rapport a la semantique 
ont ete etablies. En particulier, nous montrons que notre notion de modularite est une 
condition suffisante pour qu'une contraction soit reussie. 

Dans ce travail nous avons utilise une version faible de PDL, mais nos notions et 
resultats peuvent aussi bien s'appliquer a d'autres cadres logiques. 
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If you don't find it in the index, look very 
carefully through the entire catalogue. 
— Unknown, Sears, Roebuck, and Co. 
Consumer's Guide, 1897 
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II en a reve, il I'a fait. 



